STATE  OF  MINNESOTA 
END-OF-YEAR  REPORT 


Prepared  for 

HEW  Contract  SRS-500-75-0031 
Contract  Year  1976-1977 


Prepared  by 

Community  Health  Foundation 
Evanston,  Illinois 

June  1977 


fceSBBtt 


JiT  ' 


IOTAS' 


STATE  OF  MINNESOTA 
END-OF-YEAR  REPORT 


Prepared  for 

HEW  Contract  SRS-500-75-0031 
Contract  Year  1976-1977 


Community  Health  Foundation 
Evanston,  Illinois 


Prepared  by 


June  1977 


5  tafonrotton 
^source 


3>T  * 


TABLE  OF  CONTENTS 


Section  Page 

SUMMARY    1 

Program  Developments   1 

Technical  Assistance   Provided    3 

PROGRAM  DESCRIPTION    4 

Program  Management   4 

Identification  of  Eligibles    6 

Identification  of  Resources    6 

Notification  of  Eligibles    7 

Screening    8 

Diagnosis  and  Treatment    8 

Case  Management   9 

Data  Systems   10 

TECHNICAL  ASSISTANCE  PROVIDED    11 

RECOMMENDATIONS   14 

APPENDICES   16 


Minnesota 


SUMMARY 

Community  Health  Foundation  prepared  this  year-end  report, 
which  is  an  update  of  the  State  of  Minnesota's  program  for  Early 
and  Periodic  Screening,  Diagnosis  and  Treatment   (EPSDT) ,  in 
fulfillment  of  the  contract  obligation  with  the  Department  of 
Health,  Education  and  Welfare  —  SRS-500-75-0031  for  the  contract 
year  1976-1977. 

The  information  was  obtained  principally  through  an  assess- 
ment of  the  program  needs,  and  through  interviews  with  Minnesota's 
EPSDT  coordinator,  Nancy  Feldman. 

Program  Developments 

The  Division  of  Money  Payments  within  the  Bureau  of  In- 
come Maintenance  of  the  Department  of  Public  Welfare  has  given 
a  high  priority  to  the  recruitment  of  private  providers  as  screen- 
ers  for  the  EPSDT  program.     Efforts  are  underway  to  assess  the 
availability  of  acceptable  private  providers  on  a  regional  basis. 
By  including  private  providers  in  the  program  as  screeners,  the 
s-i-ate  expects  to  eliminate  the  shortage  of  screeners  in  the 
rural  communities. 

Screening  standards  have  been  developed  with  the  assist- 
ance of  an  ad  hoc  committee  from  the  State  EPSDT  Advisory  Com- 
mittee . 


To  assist  the  participating  providers  the  Department 
Of  Public  Welfare  has  prepared  a  comprehensive  instruction  hand- 
book called  Grow  Power  -  epsh,  „■„■„._  ,  ,„  „     ,  Thishand. 
boo.  explains  the  philosophy  and  procedures  of  the  EPSDT  pro- 
gram and  details  the  responsibilities  providers  have  to  their 
EPSDT  clients  and  to  the  Department  of  Public  Welfare. 

The  Department  of  Public  Welfare  has  also  developed  a 
handbook  for  local  welfare  departments,  called  Grow  Power  - 
BgDTJsc.1  Welfare  Agency  M,n,n!  ■     This  manual  describes  in 
detail  the  responsibilities  of  the  local  welfare  departments 
for  the  EPSDT  program. 

Both  handbooks  were  used  in  the  training  sessions  for 
Private  providers  and  local  welfare  agencies  conducted  by  the 
Department  of  Public  Welfare. 

Emphasis  is  being  placed  by  the  EPSDT  Regional  Representa- 
tives for  encouraging  local  welfare  departments  to  expand  their 
outreach  capabilities.     The  Regional  Representatives  have  been 
approaching  the  local  county  boards  in  an  attempt  to  motivate 
them  to  direct  local  welfare  departments  to  contract  with  nurs- 
ing services  for  the  provision  of  outreach  services. 

The  Governor  of  Minnesota  has  signed  legislation  permit- 
ting the  screening  of  all  four- year- olds  under  the  supervision 
of  the  Department  of  Education.     Representatives  from  the  Depart- 
ment of  Public  Welfare  the  Department  of  Health  and  the  Depart- 
ment of  Education  will  be  holding  meetings  to  establish  proce- 
dures for  coordinating  the  screening  services  each  is  responsible 
for  administering. 


The  number  of  AFDC  and  Medical  Assistance  eligibles  who 
qualify  as  EPSDT  recipients • dropped  this  year  to  94,000  from 
118,300  of  last  year.     The  decrease  is  attributed  to  an  improved 
economy  which  increased  employment  and  reduced  the  number  of 
unemployed  on  welfare. 

Technical  Assistance  Provided 


CHF  identified  and  developed  two  major  projects  for  the 


1)  A  10-page  newsletter  directed  to  potential  EPSDT 
providers.     The  editorial  content  is  to  be  extracted 
and  used  in  personalized  letters  to  physicians,  bro- 
chures, articles  for  medical  publications,  and  general 
information  announcements.     The  purpose  of  the  news- 
letter is  to  generate  interest  among  private  providers 
to  participate  in  the  EPSDT  program. 

2)  A  study  design  to  be  used  for  comparing  the  health 
status  of  medical  assistance  recipients  and  their 
behavior  in  utilizing  medical  care.     This  study 
design  of  medical  assistance  recipients  uses  specific 
indicators  to  generate  the  necessary  information  to 
compare  the  medical  care  and  health  status  of  EP^DT 
and  non-EPSDT  Medical  Assistance  recipients.     The  pur- 
pose of  the  study  is  to  determine  the  influence  the 
EPSDT  program  has  had  on  those  areas. 


Minnesota  Department  of  Public  Welfare: 
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PROGRAM  DESCRIPTION 


Program  Management 

Responsibility  for  the  EPSDT  program  continues  under  the 
direction  of  the  coordinator,  Nancy  Feldman,  MSW,  who  is  with 
the  Division  of  Money  Payments,  in  the  Bureau  of  Income  Mainten- 
ance of  the  Department  of  Public  Welfare   (DPW) .     Mary  Kennedy, 
MSW,   is  the  assistant  EPSDT  Coordinator. 

Renewal  of  the  Memorandum  of  Understanding  between  the 
DPW  and  the  Minnesota  Department  of  Health   (MDH)   is  expected 
to  occur  in  July,  1977.     The  DPW  will  be  purchasing  medical 
expertise  from  the  MDH  to  train  private  providers  and  to  con- 
tinue certifying  screening  clinics  supervised  by  nurses. 

The  Minnesota  Department  of  Public  Health  is  charged 
with  the  responsibility  for  developing  clinics  throughout 
the  state  which  will  offer  screening  services  to  all  children 
regardless  of  income.     Children  not  eligible  for  Medical  Assist- 
ance will  pay  for  the  service  on  a  sliding  fee  basis.  Current- 
ly there  are  approximately  35  clinics  operating  throughout  the 
state  which  have  been  approved  by  the  Minnesota  Department  of 
Health. 


The 


MDH  is  also  responsible  for  the  following  areas: 
Setting  standards  and  guidelines  for  EPS  screening 


1. 


2. 


Providing  EPS  technical  and  medical  expertise  to 
both  state  and  local  welfare  and  health  agencies 

Evaluating  local  EPS  programs 


3. 
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4.     Contracting  with  DPW  to  provide  training  and  techni- 
cal assistance  to  EPSDT  clinics 

While  each  local  welfare  agency  is  responsible  for  oper- 
ating the  program  according  to  the  federal  regulations,  each 
agency  has  the  option  of  delegating  program  responsibilities 
within  the  agency. 

The  DPW  has  been  instrumental  in  obtaining  the  coopera- 
tion of  the  various  agencies  participating  in  the  EPSDT  program 
to  coordinate  their  activities.     They  have  taken  steps  to  elim- 
inate the  duplication  of  screening  services  offered  to  EPSDT 
children  by  urging  the  formation  of  coordinating  committees 
within  urban  and  rural  counties.     These  committees  exchange  the 
information  necessary  to  avoid  the  duplication  of  services. 

Local  welfare  agencies  have  been  encouraged  to  pursue 
the  75%  Federal  Financial  Participation   (FFP)   funding  being 
offered  for  hiring  additional  staff  or  transferring  agency  staff 
to  provide  health  related  administrative  support  services  for 
EPSDT.     Approximately  17  counties  have  availed  themselves  of 
this  funding  source  to  hire  additional  staff  to  do  outreach 
and/or  case  management. 

Each  local  welfare  agency  has  been  encouraged  to  either 
update  their  procedures  manual  or  to  prepare  a  procedures  manual 
for  the  EPSDT  program.     The  manuals  are  to  contain  specific 
names  or  position  titles  to  identify  the  individuals  responsible 
for  each  EPSDT  function. 

The  Department  of  Public  Welfare  is  signing  a  stipulation 
with  the  Legal  Aid  Society  of  Minnesota  which  gives  Legal  Aid 


authority  to  review  copies  of  the  monthly  reports  generated  by 
DPW.     The  DPW  is  also  responsible  for  informing  Legal  Aid  about 
the  progress  of  each  county  towards  implementing  acceptable 
outreach  strategies.     The  DPW  has  agreed  to  develop  an  annual 
capability  for  screening  of  20,000  eligibles  by  January  1,  1978 
another  40,000  eligibles  by  September  1,  1978,  and  another  54,0! 
eligibles  by  March  1,  1979. 

To  reach  the  numbers  of  eligibles  to  be  screened  the  DPW 
is  actively  encouraging  private  providers  to  participate  as 
screening  resources.     The  Regional  Representatives  from  the  DPW 
have  been  actively  recruiting  eligible  private  providers  and 
have  been  evaluating  the  availability  of  acceptable  private  pro- 
vider resources.     The  Region  Representatives  have  been  visiting 
providers  to  encourage  them  to  sign  provider  agreements  and 
have  been  meeting  with  success. 

Identification  of  Eliqibles 

The  number  of  AFDC  and  Medical  Assistance  EPSDT  eligibles 
in  Minnesota  is  94,000.     The  listings  of  new  eligibles  are 
given  to  the  local  nursing  services  by  the  local  welfare  depart- 
ments. 

Identification  of  Resources 

Minnesota  has  approximately  35  screening  clinics  whose 
screening  procedures  and  criteria  have  been  approved  by  the 
state's  department  of  health.     The  state  plans  to  put  more 
such  clinics  into  operation. 
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Private  providers  are  being  encouraged  to  participate  in 
performing  the  screening  procedures  by  the  Regional  Representa- 
tives for  EPSDT.     A  resource  assessment  survey  instrument,  in 
the  form  of  a  questionnaire,  which  was  developed  by  Community 
Health  Foundation  is  used  to  identify  those  private  providers 
who  are  both  willing  and  more  importantly  qualified  to  partici- 
pate. 

While  many  providers  are  willing  to  perform  the  screenings, 
not  all  can  justify  the  capital  outlay  to  purchase  costly  equip- 
ment that  is  only  rarely  used,  such  as  an  audiometer.     The  health 
and  welfare  departments  indicated  that  they  will  work  with  the 
providers  to  resolve  such  problems. 

Notification  of  Eligibles 

Counties  which  have  contracts  With  nursing  services 
agencies  do  more  of  their  notification  by  making  home  visits. 
All  local  welfare  departments  perform  face-to-face  notification 
within  the  welfare  offices  where  the  intake  worker  has  been 
trained  to  provide  comprehensive  information  concerning  the 
EPSDT  program. 

If  an  EPSDT  eligible  requests  more  information  about 
ti.e  program,  every  effort  is  made  to  provide  the  information. 
However,  the  practice  of  requiring  those  eligibles  who  refused 
EPSDT  services  to  give  the  reasons  for  refusing  has  been  dis- 
continued, a  change  recommended  by  the  Legal  Aid  Society. 


Minnesota  is  indirectly  outreaching  potentially  eligible 
individuals  by  using  multi-media  EPSDT  promotion  campaigns. 
However,  individuals  interested  in  EPSDT  must  come  to  their 
local  welfare  department  under  their  own  initiative. 

Screening 

The  ad  hoc  committee  from  the  State  EPSDT  Advisory  Com- 
mittee has  been  providing  assistance  in  developing  screening 
standards . 

Approximately  12,500  EPSDT  recipients  have  been  screened 
during  fiscal  year  19  77  as  opposed  to  the  8,853  screened  in  fis- 
cal year  1976. 

Approximately  45%  of  the  recipients  screened  have  had 
some  kind  of  referrable  condition.  The  most  common  problems 
were  dental  and  visual  problems. 

Diagnosis  and  Treatment 

When  screening  providers  refer  someone  for  diagnosis  and 
treatment  of  a  suspected  abnormality,  they  will  give  the  parent 
a  copy  of  a  referral  form.  This  referral  for  treatment  clearly 
states  that  local  welfare  agencies  will  provide  assistance  if 
there  is  any  problem  in  obtaining  treatment  services.  This 
form,  given  by  the  screener,  eliminates  the  need  for  local  wel- 
fare agency  contact  immediately  following  the  screening. 

Minnesota  has  sufficient  numbers  of  Medical  Assistance 


providers  available  to  meet  the  demand  for  diagnostic  and 
treatment  services. 


Case  Management 

The  Department  of  Public  Welfare  has  provided  the  leader 
ship  for  developing  and  implementing  case  management  procedures 
These  procedures  are  explicitly  outlined  in  the  Grow  Power  - 
EPSDT  Local  Welfare  Aasnry  manual. 

The  DPW  has  requested  that  one  person  be  given  the  over- 
all responsibility  to  coordinate  the  program  and  to  ensure  that 
the  local  welfare  agency  is  in  compliance  with  the  regulations. 
The  following  possible  divisions  of  responsibility  for  the  pro- 
gram  functions  have  been  suggested: 

1.  Income  Maintenance  workers  can  handle  the  entire 
notification,  documentation,  and  follow-up  proce- 
dures.    Social  Service  referral  would  be  made  only 
to  arrange  transportation  and  child  care  or,  if 
holle  13  nSed'  f°r  a  follow-uP  visit  to  the 

2.  Income  Maintenance  workers  notify  applicants.  All 
screening  requests  are  referred  to  the  screening 
provider   (i.e.,  Public  Health  Nursing  Service) 

1  ??dSr  contract  *>  schedule  appointments 
follow-up.     The  contracted  agency  makes 
reports  to  the  local  welfare  agency. 

3.  a  special  unit  within  each  local  department  is  to 
be  established  to  handle  the  entire  EPSDT  program, 
including  notification,  appointment  scheduling  and 
follow-up.  3 

All  local  welfare  agencies  are  required  to  develop  their 
case  management  procedures  in  keeping  with  the  recommendations 
made  by  the  DPW.     However,  some  counties  have  developed  the 
case  management  function  beyond  the  basic  requirements  and  have 
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included  comprehensive  outreach  services   (home  visits)  as  part 
of  their  plan.     For  example,  a  slide-tape  presentation  has  been 
developed  by  the  St.  Paul  Bureau  of  Health  to  be  used  by  local 
agencies.     This  audio-visual  presentation,  called  Christina 
Learns  About  Grow  Power,  provides  information  on  the  EPSDT  pro- 
gram and  the  advantages  of  developing  preventive  health  care 
behavior.     The  slide-tape  presentation,   specific  to  the  Minnesota 
program,  has  been  widely  acclaimed  by  the  local  agencies  and  is 
available  for  $40.00. 

Data  Systems 

A  record  of  each  child's  progress  through  all  phases  of 
the  EPSDT  program  will  be  stored  in  the  computer  at  the  state 
level.     This  record,  called  the  Health  History  File,  will  be 
maintained  for  every  child  who  is  notified  about  screening. 
Reports  created  from  these  files  will  give  centralized  informa- 
tion on  the  status  of  all  EPSDT  cases  in  the  state. 

Two  reports  will  be  created  on  a  monthly  basis  from  the 
Health  History  File  and  sent  to  local  welfare  agencies  for  use 
in  administering  the  EPSDT  program. 

1.  The  County  Detail  Report  is  a  composite  report  of 
all  current  EPSDT  information  for  each  child  in 
the  county.     The  report  indicates  when  follow-up 
activities  need  to  be  performed  by  local  welfare 
agency  staff. 

2 .  The  Individual  Screening  Results  Report  shows  exactly 
what  happened  to  each  child  during  the  screening 
process  and  provides  agency  staff  with  information 
needed  to  perform  informed  follow-up. 
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TECHNICAL  ASSISTANCE  PROVIDED 


Two  areas  of  technical  assistance  were  identified  by 
the  Department  of  Public  Welfare  and  the  Community  Health 
Foundation  which  would  contribute  to  the  progress  of  the 
Minnesota  EPSDT  program.     These  are: 

1.  The  development  of  a  newsletter  directed  to  encour- 
age them  to  actively  participate  in  the  program  by 
giving  them  specific  information  about  the  concepts 
of  EPSDT. 

2.  The  development  of  a  study  design  which  would  com- 
pare the  health  status  and  medical  care  utilization 
behavior  of  Medical  Assistance  EPSDT  and  non-EPSDT 
recipients  for  the  purpose  of  determining  the  in- 
fluence the  EPSDT  program  has  had  on  those  areas.- 

The  newsletter,  Developing  the  Minnesota  Early  and 
Periodic  Screening,   Diagnosis  and  Treatment  Program,  addresses 
the  unique  information  needs  of  private  providers  in  a  brief 
and  concise  manner.     The  introduction  highlights  the  legislative 
background  of  the  health  program,   its  purpose  and  the  scope  of 
services.     A  relatively  detailed  discussion  of  Minnesota's  pro- 
gram is  presented  in  the  Current  Program  section  which  also 
explains  the  EPSDT  program  components   (e.g.,  case  management) 
and  their  importance  to  the  success  of  the  program.     This  section 
introduces  private  providers  to  the  responsibilities  and  duties 
of  those  state  and  local  agencies  and  providers  participating 
in  the  EPSDT  effort.     In  the  Problem  section,  the  newsletter 
discusses  the  background  leading  to  the  current  shortage  of 
EPSDT  screening  providers.     The  Solution  section  introduces 
the  approach  the  Minnesota  Department  of  Public  Welfare  is 
adopting  to  remedy  the  shortage  of  screening  providers.  Private 
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providers  are  further  encouraged  to  endorse  the  EPSDT  program 

by  participating  as  screening  providers. 

Nancy  Feldman,  EPSDT  Coordinator,  reviewed  the  news- 

letter  and  will  be  sending  it  out  to  medical  societies  and 

private  providers  sometime  in  the  near  future. 

The  second  project,   the  development  of  a  study  design 
for  comparing  the  health  status  and  medical  care  utilization 
behavior  of  Medical  Assistance  EPSDT  and  non-EPSDT  recipients 
has  undergone  several  revisions.     The  first  draft  sent  to  the 
Minnesota  Department  of  Public  Welfare,  which  concentrated  on 
the  case  management  function  of  MDPW  did  not  meet  their  needs 
for  a  simple,  comparative  health  status  study  design.  The 
second  draft  presents  a  comparative  study  methodology  which 
is  focused  primarily  on  the  health  status  and  medical  care 
utilization  behavior  of  EPSDT  and  non-EPSDT  Medical  Assistance 
recipients. 

The  primary  objective  of  the  EPSDT  comparison  study 
design  was  to  provide  a  methodology  for  determining  what  the 
impact  of  available  EPSDT  services  had  upon  the  health  status 
and  utilization  behavior  of  Medical  Assistance  recipients. 

To  generate  the  data  required  for  the  assessment  study, 
the  use  of  the  following  indicators  was  suggested:     1)  health 
profile  of  recipients;     2)  encounters,  classified  by  provider 
types;     3)   rates  of  encounter,   classified  by  provider  types; 
and    4)   type  of  medical  services  received  (preventive  or  non- 
preventive) . 

To  assess  the  level  of  parental  satisfaction  a  short 


questionnaire  was  included  concerning  the  EPSDT  services  re- 
ceived . 

A  cost  analysis  by  service  category  was  included  for 
comparing  the  expenditures  by  both  Medical  Assistance  groups. 

The  intent  of  this  study  design  is  to  identify  the  de- 
gree of  impact  of  the  EPSDT  effort  and  to  generate  the  neces- 
sary information  from  which  policies  can  be  developed  with 
more  confidence  for  children  who  need  diagnosis  and  treatment. 
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RECOMMENDATIONS 

The  Minnesota  Department  of  Public  Welfare  should  con- 
tinue its  efforts  to  institute  and  ensure  the  use  of  accept- 
able screening  procedures  by  private  providers. 

Once  the  use  of  acceptable  screening  procedures  are 
ensured,   the  Department  of  Public  Welfare  should  assume  the 
leadership  for  developing  aggressive  outreach  strategies. 
This  will  require  the  formation  of  ad  hoc  EPSDT  advisory  com- 
mittees consisting  of  representatives  from  all  public  agencies 
education,  health,  welfare  -  and  private  interest  groups  - 
medical  providers,  community  action  groups,  interested  citi- 
zens, private  business  -  to  develop,  implement,  and  coordinate 
outreach  activities.     These  representatives  should  be  recruited 
from  both  rural  and  urban  counties  to  reflect  the  particular 
characteristics  of  these  geographic  areas  which  could  influence 
the  design  of  the  outreach  strategy.     Different  approaches 
probably  would  have  to  be  developed  for  the  various  regions. 
The  outreach  effort  should  be  the  shared  responsibility  of  all 
the  community  agencies  involved  in  the  program. 

The  Department  of  Public  Health  should  continue  to  en- 
courage local  welfare  departments  to  apply  for  the  75%  FFP 
funds  provided  for  health-related  activities.     Local ■ county 
boards  should  continue  to  be  informed  about  the  necessity  of 
outreach,  and  they  should  be  encouraged  to  recommend  that  the 
local  welfare  departments  assume  responsibility  for  this  func- 
tion . 
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The  outreach  strategy  developed  should  also  include 
special  promotional  material  to  motivate  adolescents  to  par- 
ticipate in  the  program.     This  age-group  has  specific  health 
needs  which  must  be  identified  and  addressed. 

After  the  new  case  management  procedures    outlined  in 
the  Grow  Power-EPSDT  Local  Welfare  Agency  manual,  have  had  an 
opportunity  to  be  fully  operationalized,  the  Department  of 
Public  Welfare  should  consider  evaluating  the  impact  the  case 
management  system  is  having  both  on  the  internal,  administra- 
tive" functions  of  the  agency,   and  on  the  recipient's  ability 
to  get  the  health  care  needed. 

A  process  evaluation  of  the  case  management  system  is 
required  to  determine  if  the  recommended  procedures  are  being 
effectively  administered.     This  assessment  of  program  manage- 
ment function  is  a  prerequisite  for  evaluating  the  impact  of 
the  case  management  system  on  the  EPSDT  recipients.     The  Cuse 
management  impact  study  would  determine  whether  the  health 
status  or  medical  care  utilization  behavior  of  EPSDT  recipients 
is  being  profoundly  effected.     Such  a  study  could  reveal  defi- 
ciencies in  the  operating  case  management  system  which  could 
be  corrected  to  have  a  more  positive  impact  on  the  recipients 
and  on  the  management  of  the  EPSDT  program. 
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APPENDIX  A. 


Minnesota  Provider  Relations  Strategy 


MINNESOTA  PROVIDER  RELATIONS  STRATEGY 


GOAL: 


OBJECTIVES: 


METHODOLOGY : 


Signed  agreements  with  providers  in  adequate 
numbers  to  meet  requirements  for  screening 
eligible  population.     (The  degree  to  which 
screening  and  subsequent  diagnosis  and  treatment 
are  necessary  may  well  be  determined  by  consent 
decree. ) 

1.  Educate  physicians  and  other  providers  about 
EPSDT  program  on  the  national  and  state  scene. 

2.  Contact  providers  and  obtain  signed  agreements 


1. 


Establish  liaison  with  provider  organizations 
in  the  state: 


-  AAFP 

-  AAP 

-  MMA 

-  MHA 

-  MEA 

-  HS 

2      Discuss  with  each  organizational  representative 
how  the  EPSDT  goal  and  objectives  can  be 
pursued  in  their  organizations. 

3.  Prepare  EPSDT  article  for  each  association 
newsletter  covering  the  program  at  the  . 
national  and  state  levels. 

4.  Assist  each  organization  president  or  EPSDT 
designate  to  obtain  endorsement  of  his/her 
organization  for  the  standards  to  be  met 

by  providers  of  EPSDT  services. 

5.  Prepare  lists  of  providers  to  be  enlisted  to 
serve  EPSDT  recipients. 

6  Prepare  articles  for  association  newsletters 
on  EPSDT  standards  with  accompanying  request 
for  providers  to  indicate  their  willingness 
to  participate  in  EPSDT  and  their  capacity 
for  providing  services  to  EPSDT  recipients. 

7  Arrange  to  participate  in  county  medical 

"     society  meetings  in  those  counties  where  more 
providers  are  needed.     Enlist  providers  at 
those  meetings. 


8.  Make  personal  contact  with  providers  in 
areas  where  deficiencies  still  remain. 

9.  Arrange  for  ongoing  two-way  communications 
with  providers  so  that  criticisms,  instruc- 
tions and  appreciations  may  be  expressed. 

EVALUATION:       County  by  county  tabulation  of  provider  enrollment 
and  determination  of  adequacy  of  numbers  of 
provider  resources  per  population  needing  and 
wanting  services. 


APPENDIX  B. 


Developing  the  Minnesota  Early  and  Periodic 
Screening,  Diagnosis  and  Treatment  Program 


Introduction 

o  manv  costly,  chronic,  disabling  health 
Because  so  many  cot>uxjr, 

v,  «.  hearing  and  visual  impairments,  develop- 
conditions,  such  as  hearing  a 

,     •     i  Ai Borders  and  dental  problems  could 
mental  delays,  neurological  disorders 

.  4        the  early,  critical  years  of  life, 
be  diminished  if  detected  in  the  early, 

the  Feaeral  Government  mandated  in  1967  that  all  states  imple- 
ment an  identifiable  Early  and  Periodic  Screening,  Diagnosis 

4-  a=  nart  of  their  Medicaid 
and  Treatment  (EPSDT)  component  as  part  of 

tA*~n  financial  assistance 
program.    !n  addition  to  »erely  providing  financi. 

for  EPSDT  services,  which  has  heen  the  role  of  the  «edica 
program  in  the  past,  states  are  retired  to  U>  educate  .  i- 
gible  families  in  the  importance  of  preventive  health,  (2) 
encode  eligihle  families  to  participate  in  the  program. 

r\f  crreeninq  services 
a«a  arranae  for  the  provision  of  screening 
(3)  assure  and  arrange 

,  a     (4)  offer  assistance  in  making  appointments 
when  requested,    (4)  otrer 

.    •       ~*  transDortation  and  day  care 
for  the  provision  of  transport u 
and  arranging  tor  tne 

oracles  that  prevent  the  eligible 
services  to  help  overcome  obstacles  tna  p 

*  corvice     (5)   inform  eligible 

family  from  taking  advantage  of  the  servrce.  (« 

families  in  need  of  diagnostic  and  treatment  services  of 
names  and  locations  of  health  providers,  «,  assure  that 
aUgihle  families  are  receiving  revested  and  ^      e  ces 

ki«  time  period,  and  (7)  document  that  all 
within  a  reasonable  time  perxu 
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requirements  stated  in  the  Federal  regulations  are  being  met. 
In  1972,  the  Congress  legislated  a  penalty  to  be  imposed  on 
states  which  do  not  comply  with  Medicaid-EPSDT  requirements. 
The  penalty  regulations  and  penalty  reviews  became  effective 
in  July  1974. 

Current  Program 

Minnesota  has  approximately  118,000  children  who  are 
eligible  for  EPSDT  services.     The  Minnesota  EPSDT  program  is 
administered  by  the  Department  of  Public  Welfare.     A  regional 
approach  to  implementation  is  being  undertaken  which  places  a 
coordinator  in  each  of  six  regions  to  assist  local  planning  and 
assessment  of  program  problems. 

The  regional  coordinator's  duties  are: 

1.  To  ensure  that  all  local  welfare  agencies  are  per- 
forming the  tasks  necessary  for  the  EPSDT  program 
to  meet  federal  requirements. 

2.  To  devise  and  implement  a  resource  plan  so  that 
there  will  be  sufficient  screening  services  avail- 
able to  screen  approximately  one-third  of  the 
EPSDT  eligible  children  in  the  region  each  year. 

3.  To  provide  training  and  technical  assistance  to 
welfare  departments  in  the  region  so  that  compre- 
hensive health  care  is  available  to  all  children 
eligible  for  medical  assistance. 

4.  To  promote  EPSDT  outreach  activities  within  the 
region  and  provide  technical  assistance  to  all 
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agencies  involved  in  outreach. 

5.  To  coordinate  the  activities  of  agencies  providing 
health  care  to  children  within  the  region  so  that 
duplication  and  the  amount  of  unreported  services 
are  reduced. 

6.  To  assess  the  availability  of  diagnostic  resources 
so  that  EPSDT  eligible  children  requiring  such 
services  may  receive  them. 

7.  To  assist  in  the  development  of  statewide  policies 
so  that  regional  concerns  and  problems  are  re- 
flected in  such  policies. 

Screening  services  are  provided  primarily  by  private 
physicians  with  supplemental  screening  being  provided  by  the 
Minnesota  Department  of  Health  Early  and  Periodic  Screening 
(EPS)   clinics.     These  clinics  are  located  in  physician  deficient 
areas . 

The  success  of  the  EPSDT  program,  as  required  by 
Federal  regulations,  rests  primarily  in  the  area  of  case 
management.     The  purpose  of  case  management  is  to  ensure  that 
EPSDT  recipients  receive  the  health  services  which  they  need, 
and  want,  within  a  reasonable  period  of  time.     EPSDT  case 
management  does  not  include  making  decisions  about  the  care  of 
specific  medical  problems.     Instead,  case  management  is  con- 
cerned with  facilitating  and  maintaining  the  recipient's 
contact  with  a  comprehensive,  and  continuous,  health  care 
service  source. 

Case  management  involves  the  following  ancillary 
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services  apart  from  the  actual  delivery  of  health  care: 

1.  Informing  the  clients  about  the  EPSDT  program 

2.  Assisting  in  selection  of  providers 

3.  Arranging  the  screening  appointments 

4.  Assisting  with  support  services 

5.  Following-up  on  screening  appointments 

6.  Arranging  for  diagnostic  and  treatment  services 

7.  Following-up  on  diagnosis  and  treatment 

Case  management  is  the  responsibility  of  the  county 
Welfare  Department  and  is  assisted  by  public  health  nurses 
who  provide  much  of  the  follow-up  for  children  screened  in 
the  EPS  clinics. 

Problem 

Currently,  only  10,000  of  Minnesota  eligible  children 
have  received  EPSDT  services.     This  low  rate  was  largely 
attributed  to  an  inadequate  number  of  primary  care  physicians 
available  for  screening,  diagnosis  and  treatment.     The  state 
has  agreed  to  develop  the  capacity  to  screen  54,000  children 
each  year  in  order  to  remain  in  compliance  with  Federal  EPSDT 
regulations.     If  this  goal  is  not  met,  the  result  could  be  a 
substantial  financial  penalty  to  the  state. 

Solution 

One  of  the  solutions  to  the  problem  of  providing 
screening  for  a  greater  number  of  children  is  to  increase 
physician  participation  in  the  EPSDT  program.     The  Minnesota 
Academy  of  Pediatrics,  the  Minnesota  Medical  Association  and 
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the  Minnesota  Academy  of  Family  Practice   (along  with  other 
health  organizations)   have  endorsed  the  Minnesota  EPSDT  pro- 
gram and  representatives  of  these  organizations  are  active 
members  of  the  Minnesota  EPSDT  Advisory  Committee.     It  is  the  ■ 
desire  of  the  State  of  Minnesota  to  engage  the  participation 
of  as  many  physicians  as  possible  in  the  EPSDT  program  and, 
thereby,  to  further  implement  Minnesota's  commitment  to  the 
delivery  of  health  services  to  all  children. 

Current  Developments 

There  are  a  number  of  current  developments  being 
undertaken  whioh  will  facilitate  the  ultimate  success  of  the 
program.     An  EPSDT  Advisory  Committee  is  currently  meeting  to 
establish  minimum  and  definite  standards  for  screening  acti- 
vities.    This  will  more  clearly  define  the  screening  package, 
result  in  increased  comparability  of  services,  and  more 
clearly  articulate  the  input  of  the  physician  into  the  program. 
A  handbook  has  been  developed  that  clearly  defines  physician 
participation  and  encourages  communication  between  the  doctor 

and  the  EPSDT  program. 

The  EPSDT  invoice  has  been  streamlined  to  serve  as 
both  an  invoice  for. payment  and  a  report  of  screening  findings. 
This  form  is  being  processed  on  a  high-speed  computerized 
basis  for  minimum  paperwork  and  greater  office  efficiency. 

on  the  national  scene,  an  exciting  renovation  of 
the  present  program  is  being  projected.     A  new  and  expanded 
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program,  that  would  involve  approximately  15  million  low 
income  families, is  being  proposed  by  the  Carter  administra- 
tion.    The  program  is  called  Comprehensive  Health  Assessment 
and  Primary  Care  for  Children  (CHAP) .     CHAP  will  include 
financial  incentives  to  states  to  provide  screening,  diag- 
nosis and  treatment  through  comprehensive  care  centers.  An 
additional  $180  million  have  been  proposed  for  1978  expendi- 
tures.    The  new  budget  also  proposes  $6  million  for  the 
immunization  of  low  income  children,  whose  level  of  protectior 
against  many  of  the  childhood  communicable  diseases  has 
dropped  dramatically  in  very  recent  years. 

Conclusion 

The  growth  and  development  of  the  EPSDT  program  is 
being  determined  on  the  local,  state  and  national  levels. 
The  EPSDT  program  needs  the  participation  of  Minnesota  phy- 
sicians to  help  determine  the  course  of  the  program  and  to 
provide  primary  health  care  for  more  children. 

Physician  participation  in  the  EPSDT  program  is 
essential  to  its  success.     Physician  involvement  in  screening 
may  be  as  providers  or  as  advisors  to  local  screening  acti- 
vities.    Diagnosis  and  treatment  is  provided  by  physicians. 

To  gain  a  greater  understanding  of  the  EPSDT  program 
and  to  determine  your  role  in  the  program,  please  write  to 

EPSDT  Section 

Bureau  of  Income  Maintenance 
Department  of  Public  Welfare 
4th  Floor,  Centennial  Office  Building 
St.  Paul,  Minnesota  55155 
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Introduction  to  the  Problem.     The  need  to  study  the  impact 
of  the  EPSDT  program  on  the  health  status  of  recipients  and 
upon  their  utilization  of  medical  services  exists  because 
the  program  has  required  the  commitment  of  substantial  man- 
power and  financial  resources.     The  EPSDT  program  is  based 
on  the  assumption  that  preventive  health  services  and  early 
intervention  for  identified  problems  will  increase  health 
status  and  decrease  utilization  of  medical  services.  The 
effectiveness  of  the  program  is  reflected  in  the  extent  to 
which  these  assumptions  are  validated.     This  paper  presents 
one  approach  for  determining  the  impact  of  EPSDT  services 
upon  the  health  status  and  the  medical  care  utilization  be- 
havior of  EPSDT  recipients. 

Administrative  Ramifications  of  the  EPSDT  Concept.  Justifi- 
cation for  establishing  the  EPSDT  program  centered  on  the 
premise  that  medically  needy,  low-income  families  were  en- 
countering obstacles  preventing  them  from  receiving  the  health 
benefits  that  could  be  realized  by  participating  in  a  compre- 
hensive medical  care  delivery  system  providing  continuity  of 
care.     The  developers  of  the  EPSDT  program,  recognizing  this, 
mandated  that  a  responsive  '  support  system  be  designed  to 
help  the  medically  needy  gain  entry  and  remain  in  a  comprehen- 
sive medical  care  system  for  identification  and  remediation  of 
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health  needs. 

The  EPSDT  program  requires  the  provision  of  case  manage- 
ment services  which  will: 

1)  encourage  program  recipients  to  make  more  use  of 
preventive  medical  care; 

2)  determine  if  the  required  screening,  diagnostic 
and  treatment  services  were  provided  on  a  timely 
basis; 

3)  provide  recipients  with  the  necessary  support 
services,  such  as  transportation  and  day  care, 
to  ensure  access  to  the  screening,  and  to  the 
diagnostic  and  treatment  services  needed. 

The  case  management  requirement  makes  EPSDT  different 
from  the  traditional  Medical  Assistance   (Medicaid)  program. 
Whereas,  Medicaid  is  basically  a  reimbursement  program,  EPSDT 
is  both  a  service  and  a  reimbursement  program.     That  is,  the 
single  state  agencies  administering  the  EPSDT  program  have 
duties  and  responsibilities,  mandated  by  the  federal  regula- 
tions, which  direct  them  to  assist  recipients  in  obtaining 
services,  to  document  services  provided,   to  follow-up  on  iden- 
tified problems  and  to  report  service  activities.     This  unprec- 
endented  case  management  requirement  makes  the  EPSDT  single 
state  agency  accountable  for  the  medical  care  obtained  by  EPSDT 
recipients. 

An  Approach  for  Assessing  Program  Impact.     The  basic  strategy 
adopted  here  requires  the  random  selection  of  a  representative 
sample  of  EPSDT  recipients  whose  health  status  and  medical 
care  utilization  behavior  can  be  compared  with  another  random- 
ly selected  sample  of  Medical  Assistance  non-EPSDT  recipients. 
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The  indicators  chosen  for  this  study  would  at  least: 

1)  identify  the  health  profile  of  each  group  of  recipients; 

2)  classify  encounters  by  provider  types;  3)  establish  rates 
of  encounter  by  provider  types;  and  4)  separate  the  types  of 
medical  services  received  into  preventive  and  non-preventive 
care.  By  using  these  indicators  and  comparing  the  tabulated 
data  a  determination  can  be  made  of:  1)  the  extent  to  which 
each  group  uses  preventive  medical  care  services;  and  2)  the 
degree  of  well-being  and/or  morbidity  exhibited  by  each  group. 

Rounding-out  the  Evaluation  Approach.     While  the  main  emphasis 
of  the  comparative  study  design  presented  here  is  on  evaluating 
the  impact  of  the  EPSDT  program  upon  the  health  and  medical 
care  experiences  of  recipients,  it  was  felt  that  a  total  eval- 
uation approach  should  include  input  from  the  parents  of  the 
recipients  as  well  as  cost  information.     Therefore,  in  addition 
to  the  indicator  strategy,  a  short  questionnaire  was  developed 
to  assess  the  level  of  satisfaction  of  parents  with  the  EPSDT 
services  received  by  their  children.     Also,  a  framework  for  a 
cost  analysis  by  service  category  has  been  included  for  comparing 
the  expenditures  made  for  both  Medical  Assistance  groups  (i.e., 
eligibles  who  have  received  EPSDT  services  vs.  those  who  have 
not. ) 


Methodological  Issues 

Although  this  study  design  is  presented  primarily  as  a 
simple  comparative  study,  it  can  readily  be  adapted  as  a  longi- 
tudinal comparative  study.     The  same  indicators  can  be  used 
in  either  case. 

Although  the  comparative  design  is  simpler,  the  infer- 
ences which  can  be  made  from  it  are  limited. 

In  a  comparative  study  recently  completed  by  CHF,  it  was 
clearly  demonstrated  that  compared  to  non-EPSDT  Medicaid  clients, 
EPSDT  participants  used  fewer  inpatient  services,   and  more  ambu- 
latory services.     They  incurred  lower  per  capita  expenditures 
for  medical  services  and  lower  cost  per  unit  of  medical  service. 

However,  it  is  difficult  to  assess  how  much  of  these 
differences  are  directly  attributable  to  the  effect  of  the  EPSDT 
program.     The  EPSDT  program  may  influence  the  utilization  of 
health  care  and  the  cost  of  health  care  in  several  different 
ways : 

1.  It  may  reduce  utilization  and  costs  by: 

a.  Educating  clients  how  to  use  services  more 
appropriately. 

b.  Referring  clients  to  high  quality  providers 
who  discourage  inappropriate  utilization, 
and/or  deliver  service  at  a  lower  cost  per 
unit. 

c.  Preventing  illness  and  handicapping  condi- 
tions through  immunization,  health  education, 
and  early  detection  and  treatment  of  health 
problems. 

2.  It  may  increase  utilization  initially  by  uncovering 
the  backlog  of  untreated  health  problems. 

3.  It  may  decrease  the  cost  of  care  by  shifting  utili- 
zation from  inpatient  services  to  ambulatory  ser- 
vices. 
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However,  other  factors  may  account  for  some  of  the  dif- 
ferences between  EPSDT  participants  and  non-EPSDT  Medicaid  clients 
in  utilization  of  services  and  cost  of  services. 

In  a  study  of  a  Children  and  Youth  Program,  Leopold   (1974) 1 
found  that  the  children  who  need  health  services  most,  are  the 
most  difficult  to  reach.     Children  who  are  most  likely  to  use 
preventive  health  services  are  the  healthiest  children,  and  are 
also  more  likely  to  use  other  health  services. 

If  the  EPSDT  children  are  in  fact  healthier  than  other 
Medicaid  children  prior  to  receiving  EPSDT  services,  then  this 
might  account  for  some  of  the  lower  rate  of  inpatient  utiliza- 
tion, lower  cost  per  capita  and  lower  cost  per  unit  of  service. 

Furthermore,   if  EPSDT  children  are  generally  more  likely 
to  use  health  services,   than  non-EPSDT  Medicaid  Children,  this 
might  account  for  the  higher  rate  of  utilization  for  ambulatory 
services. 

In  order  to  assess  the  extent  to  which  these  selection 
biases  may  contribute  to  the  differences  in  utilization  and 
cost,  a  longitudinal  design  is  needed.     Ideally,  a  time-series 
analysis  should  be  done  of  both  the  EPSDT  population  and  non- 
EPSDT  Medicaid  children.     The  analysis  should  include  measures 
of  health  status,  utilization,  service  cost  per  capita,  and 
cost  per  unit  service. 

The  longitudinal  design  makes  it  possible  to  determine, 
if  the  EPSDT  and  non-EPSDT  populations  are  in  fact  equivalent 
in  health  status  and  service  utilization  before  EPSDT  services 
are  provided.     In  the  longitudinal  design,  the  focus  of  analysis 

1Leopold,  Edith  A.,  Whom  Do  We  Reach?     A  Study  of  Health 

Care  Utilization,  Pediatrics,  Vol.   53,  No.   3,  March,  1974 
pp.  341-348. 


is  the  direction  and  magnitude  of  change  in  health  status  and  ser- 
vice utilization  for  both  groups,  and  the  difference  between  the 
groups  in  magnitude  of  change. 

Although  the  longitudinal  design  is  optimal,  the  simple 
comparative  design  will  provide  a  rough  estimate  of  the  upper 
limit  of  the  short-run  program  impact  of  the  EPSDT  program. 
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The  Study  Design 

The  primary  focus  of  the  EPSDT  effort  is  the  prevention 
and  early  detection  of  abnormal  health  conditions  followed  by 
their  prompt  diagnosis  and  treatment.     To  determine  the  impact 
of  EPSDT  on  Medical  Assistance  recipients,  a  comparative  study 
has  been  designed.     The  two  characteristics  selected  as  the 
focus  for  comparing  EPSDT  and  nonEPSDT  recipient  populations 
are  health  status  and  the  patterns  of  medical  care  utilization. 
Specific  indicators  have  been  selected  to  measure  these  reci- 
pient characteristics. 

I.     Health  Status 

The  two  needs  for  which  individuals  seek  health  care 
are  illness  and  prevention.     Each  category  of  need  is  a  reflect- 
ion of  health  status  and  can  be  assessed  for  individuals  as  for 
a  group  of  individuals.     When  data  in  these  categories  is  aggre- 
gated for  EPSDT  and  nonEPSDT  Medical  Assistance  populations, 
it  is  possible  to  compare  the  health  status  of  the  two  groups 
to  determine  the  impact  of  EPSDT. 

ILLNESS  NEEDS:     This  aspect  of  health  status  can  be  evaluated 
by  constructing  a  frequency  table  of  illness  problems  identified. 
The  frequency  table  can  be  used  to  graphically  display  the  num- 
ber of  people  with  each  illness  in  each  population  or  the  number 
of  diagnosed  illnesses  of  each  type  in  each  population,  as  fol- 
lows : 
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This  should  be  done  for  the  nonEPSDT  population  first. 
The  illness  needs  of  that  population  were  used  to  partially 
justify  the  EPSDT  effort.     The  frequency  table  for  illnesses 
in  the  EPSDT  population  should  include  only  the  same  illnesses 
as  the  nonEPSDT  table.     Health  conditions  identified  as  a  re- 
sult of  the  screening  effort  should  not  be  included  since 
they  can  be  expected  to  exist  with  similar  or  greater  frequency 
in  the  nonEPSDT  population.     Probably  the  most  convenient  data 
source  for  constructing  the  frequency  tables  is  the  Medicaid 
claims  files. 

When  the  prevalence  rates  determined  from  the  frequency 

tables  for  the  two  populations  are  compared,  any  differences 

may  be  interpreted  as  an  estimate  of  the  upper  limit  of  the  EPSDT 

program's  impact. 

Prevalence  Rate        Number  of  cases  of  a  given  illness 

by  =  per  year  per  group 

Disease  Category      =  ■=  =  r — —.  

^     *       Program  Sample  Population 

PREVENTIVE  NEEDS;     To  make  the  health  status  evaluation  complete, 


it  is  necessary  to  know  to  what  degree  the  two  populations  have 
received  the  screening,  diagnosis  and  treatment  services  required 
by  EPSDT. 

As  in  the  case  of  illness  needs,  preventive  needs  can 
be  reflected  on  frequency  tables.     The  tables  can  show  the  num- 
ber or    percentage  of  individuals  in  each  population  who  have 
completed  the  required  services  within  the  periodicity  time 
frame  as  follows: 
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When  evaluating  the  preventive  needs  of  each  group  it 
would  be  inappropriate  to  ignore  those  preventive  health  ser- 
vices which  were  provided  as  a  result  of  a  medical  complaint. 
For  example,  if  a  child  presents  a  medical  complaint  to  a  provider, 
the  provider,  in  his/her  effort  to  determine  the  cause  of  the 
complaint  may  request  that  a  series  of  tests  be  conducted  in 
order  to  diagnose  the  complaint.     Some  of  these  tests  (e.g., 
blood  analysis,  urinalysis,  etc.  are  equivalent  to  the  tests  re- 
quired in  the  EPSDT  screening  package.     In  looking  for  the  cause 
of  the  medical  complaint,   the  provider  is  also  assessing  the 
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health  status  of  the  individual.     If  other  ailments  are  un- 
covered, then  treatment  is  recommended.     In  part,  this  is  ful- 
filling the  preventive  health  obligations  of  the  EPSDT  program. 
If  the  non-EPSDT  recipient  becomes,  at  a  later  date,  an  EPSDT 
recipient,  then  it  may  not  be  necessary  to  repeat  those  tests 
(depending  upon  the  periodicity  schedule  and  the  recipient's 
age)   administered  previously.     Therefore,   even  though  Medical 
Assistance  non-EPSDT  recipients  may  not  be  getting  preventive 
health  services  through  the  efforts  of  the  EPSDT  program,  they 
may  be  receiving  some  preventive  health  services  through  the 
efforts  of  the  diagnostic  provider  in  pursuit  of  a  medical 
complaint.     These  services  should  be  counted  because  they  do 
contribute  to  the  improvement  of  the  health  status  of  the  reci- 
pient. 

Frequency  tables  can  also  be  constructed  for  diagnosis 
and  for  treatment  of  problems  identified  at  screening.  These 
tables  should  indicate  the  percentage  of  each  category  of  ser- 
vice which  is  initiated  and  completed  respectively.     These  tables 
can  be  used  to  compare  each  population  with  EPSDT  case  management 
performance  standards  as  well  as  to  compare  the  populations  with 
one  another. 

There  are  other  measures  of  health  status  which  may  be 
useful  even  though  gross  in  nature.     One  measure  is  the  percen- 
tage of  each  population  which  is.  completely  well  at  the  time  of 
examination.     This  can  be  determined  by  dividing  the  number 
found  to  be  completely  well  on  screening  by  the  number  screened 
and  multiplying  by  100.     For  the  nonEPSDT  Medicaid  population 
this  information  should  be  available  for  the  preschool  population 
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now  being  routinely  offered  screening  services. 
II .     Medical  Care  Utilization 

Studying  the  medical  care  utilization  behavior  of 
individuals  and  populations  has  become  necessary  because  of  the 
close  relationship  between  patterns  of  utilization  and  health 
status,  cost,  planning,  resource  deployment,  etc.     The  emphasis 
of  the  EPSDT  program  is  on  encouraging  recipients  to  use  contin- 
uous sources  of  care  which  can  meet  a  broad  spectrum  of  prevent- 
ive and  curative  needs.     To  measure  the  impact  of  EPSDT  on  medi- 
cal care  utilization,   the  type  of  provider  encountered,  the 
rates  of  encounter  and  the  type  of  health  services  provided 
have  been  selected  as  indicators. 
TYPE  OF  PROVIDER  ENCOUNTERED; 

A.     For  each  set  of  health  care  needs,  certain  types  of  providers 
are  most  appropriate  as  a  source  of  care.     For  example, 
emergency  rooms  are  appropriate  providers  of  care  following 
injuries  and  acute  medical  crises  while  physicians  offices, 
outpatient  departments  and  neighborhood  health  centers  are 
capable  of  meeting  the  majority  of  a  recipient's  primary 
care  needs  and  providing  medical  care  on  a  continuous  basis. 
Medical  care  utilization  by  EPSDT  and  nonEPSDT  populations 
can  be  evaluated  by  noting  the . frequency  with  which  various 
provider  types  are  encountered.     (See  Appendix  C  for  examples 
of  criteria  for  assessing  the  appropriateness  of  care.). 
Tables  A  &  B  in  Appendix  A  provide  the  formats  for  displaying 
the  frequency  of  encounters  by  provider  type  and  the  average 


number  of  provider  types  used.     Each  Medical  Assistance 
population  sampled  is  divided  into  age,  race,  sex,  and 
residence  categories.     With  this  information  an  assessment 
of  the  encounter  pattern  for  each  group  can  be  made . 
B.     Another  aspect  of  medical  care  utilization  is  continuity 
of  care.     This  is  an  important  prerequisite  for  motivating 
individuals  to  assume  greater  responsibility  for  obtaining 
the  health  care  they  need  on  a  timely  basis.     When  health 
care  delivery  is  fragmented,  and  when  no  single  provider 
source  exists,  the  recipients  tend  to  not  identify  them- 
selves as  necessary  participants  in  the  preventive  health 
care  effort.     The  mean  number  of  different  types  of  provi- 
ders and/or  individual  providers  used  per  recipient,  per 
year  serves  to  measure  the  continuity  of  care  of  recipients. 
Ideally,  an  index  of  continuity  of  care  should  measure 
the  number  of  different  providers  visited  without  appropriate 
referral.     Some  information  on  appropriateness  of  medical  re- 
ferrals may  be  difficult  to  obtain.     However,  certain  useful 
assumptions  can  be  made.     For  example,  if  a  client  uses  only 
one  dentist  and  one  optometrist,  these  providers  should  not  be 
counted  as  a  part  of  the  continuity  of  care  index.  However, 
each  additional  dentist  or  optometrist  should  be  counted  unless 
there  is  evidence  of  an  appropriate  referral  to  a  specialist 
■  such  as  an  orthodontist,  periodontist,  etc.      (For  a  more  detailed 
treatment,  see  "A  Quantitative  Measure  of  Continuity  of  Care", 
Bice,  Thomas  W.  and  Boxerman,   Stuart  B.,  Medical  Care,  April, 
1977,  Vol.  XV,  No.   4,  pp.  347-49.) 
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If  the  format  of  Table  B  is  followed  using  mean  number 
of  types  of  providers  used,   it  provides  a  crude  index  of  con- 
tinuity of  care.     If  mean  number  of  individual  providers  used 
is  selected  as  the  index,  more  precise  measurement  is  possible. 
RATES  OF  ENCOUNTER:     The  rates  at  which  recipients  engage  pro- 
viders varies  with  provider  availability  and  the  ability  of  the 
provider  to  meet  the  perceived  needs  of  the  recipient.  EPSDT 
has  attempted  to  increase  the  availability  of  providers  of  con- 
tinuous health  care  to  EPSDT  recipients,  to  assist  the  recipient 
to  obtain  the  required  service  and  to  alter  the  health  needs 
perceived  by  the  recipient.     The  degree  to  which  this  has  been 
done  will  be  reflected  in  part  in  the  rates  of  health  encounter 
by  EPSDT  recipients  compared  to  nonEPSDT  recipients. 

Two  specific  rates  of  encounter  were  chosen  for  this 
assessment.     They  are: 

(1)  the  mean  rate  of  medical  provider  visits  per  person, 
per  year,  and; 

(2)  the  mean  rate  of  dental  visits  per  person,  per  year. 
The  first  of  these  two  encounter  rates  is  an  overall 

measure  of  the  recipient's  utilization  of  medical  care  providers. 
This  encounter  rate  can  be  compared  with  the  provider  encounter 
rate  statewide  or  nationally  as  a  measure  of  EPSDT  impact  at 
the  local  level. 

The  second  encounter  rate  is  an  overall  measure  of  dental 
health  care  utilization.     This  measure  reflects  the  degree  of 
perceived  need  for  dental  services  and  the  influence  of  each 
program  towards  motivating  individuals  to  seek  dental  care. 

Table  C  in  Appendix  A  illustrates  the  format  for  display- 


ing  and  comparing  the  data  obtained  from  these  indicators. 
Tables  D  &  E  in  Appendix  A  offer  other  approaches  to  examining 
encounter  rates. 

TYPE  OF  HEALTH  SERVICE  PROVIDED;     The  indicators  used  in  this 
section  are  intended  to  measure  the  service  demands  placed  upon 
the  health  care  sector  by  the  recipients  in  both  groups.  These 
indicators  produce  uniform  data  from  which  inferences  can  be 
made  about  the  health  status,  the  preventive  care  utilization 
behavior,  and  the  acceptability  of  the  services  obtained  by 
each  group. 

A.  The  number  of  well-care  visits  per  1,000  recipients,  per 
year  reflects  the  desire  of  the  recipient  to  use  preventive 
medical  services.  As  stated  in  the  Health  Status  section 
of  this  study  design,  EPSDT  is  also  interested  in  the  util- 
ization behavior  of  recipients  who  have  not  been  found  ill. 
Table  F  in  Appendix  A  illustrates  the  format  to  be  used  for 
tabulating  the  data  collected. 

B.  The  number  of  preventive   (for  prophylactic  care)  dental 
visits  per  1,000  recipients,  per  year  reflects  the  desire 
of  the  recipient  to  use  preventive  dental  service.     Table  C, 
in  Appendix  A  illustrates  the  format  used  for  tabulating 
the  data  obtained.     Refer  to  Interpretation  of  Results 
section  for  further  discussion. 

C.  The  number  of  inpatient  hospital  admissions  and/or  hospital 
days  per  1000  recipients  per  year  can  be  used  to  demonstrate 
the  utilization  patterns  of  hospital  care  by  a  population. 
It  is  also  an  indirect  measure  of  the  health  status  of  the 
population.     That  is,  if  the  rate  of  admissions  and/or  the 
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number  of  hospital  days  for  a  given  sub-population  is  higher 
than  the  population  average,   then  that  sub-population  may 
be  experiencing  a  greater  incidence  of  illness.     This  find- 
ing would  be  of  particular  concern  if  the  admission  rate 
and/or  the  number  of  hospital  days  was  the  result  of  a  sub- 
population  not  experiencing  appropriate  preventive  health 
care  services.     Table  H  in  Appendix  A  presents  the  recommended 
method  for  formatting  this  data. 

The  number  of  hospital  admissions  by  specific  illness  per 
1000  recipients  per  year  is  a  further  refinement  of  the 
preceding  utilization  indicator.     Certain  conditions  requir- 
ing hospital  admission  are  more  severe  and  costly  than  others. 
It  is  therefore  of  value  to  determine  the  major  reasons  for 
hospital  admissions  per  population  sampled.     This  information 
would  reveal  the  relative  health  status  of  both  groups. 

In  conjunction  with  this  the  average  length  of  stay  per 
group  and  the  average  cost  per  recipient  would  be  good  indi- 
cators to  include  for  measuring  the  impact  EPSDT  has  in  con- 
trolling these  factors. 

Table  I  in  Appendix  A  is  an  example  of  the  formatting 
to  be  used  for  each  of  the  major  reasons  for  hospital  ad- 
mission. 
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Summary 

The  impact  of  any  single  program  is  best  determined 
through  the  utilization  of  indicators  that  are  specific  and 
sensitive.     The  indicators  chosen  to  be  incorporated  in  this 
study  design  will  measure  the  health  status  of  the  sampled 
populations,  the  providers  utilized  by  the  recipients,  the 
rate  of  utilization,  and  the  type  of  health  care  services 
provided.     From  this  information,  the  effect  of  the  EPSDT  ef 
fort  can  be  estimated. 


16 


The  best  approach  for  conducting  this  assessment  study 
might  be  to  examine  the  files  of  all  Medical  Assistance  EPSDT 
and  nonEPSDT  recipients  for  each  category  of  information  to  be 
studied.     However,   time,  manpower,  and  financial  constraints 
would  make  such  an  approach  impractical.     Therefore,  it  becomes 
necessary  to  observe  the  recipient  characteristics  we  are  in- 
terested in  (i.e.,  health  status,  and,  medical  care  utilization 
behavior)  by  studying  some  number  less  than  the  entire  popula- 
tion . 

Sampling  must  be  carefully  done  to  avoid  introducing 
biases  into  the  study.     Biases  may  result  from  selecting  a 
sample  not  representative  of  the  entire  population.    A  biased 
sample  would  destroy  the  validity  of  any  interpretation  made 
from  the  collected  data. 

The  simplest  and  most  commonly  used  sampling  strategy 
would  be  to  randomly  select  members  of  the  population  to  be 
representative  of  the  entire  population  of  recipients.  This 
can  be  accomplished  with  the  Medical  Assistance  population  by 
using  the  assigned  identification  numbers  and  a  table  of  random 
numbers.     The  members  of  each  group  can  be  further  divided  into 
demographic  categories  such  as  age,  sex,  place  of  residence 
and  duration  in  the  program. 

In  establishing  representative  populations  it  is  recom- 
mended that  only  those  recipients  who  have  been  in  their  respec- 
tive program  continuously  for  a  period  of  no  less  than  one  year 
be  selected.     This  period  would  allow  sufficient  time  for  the 


17 


recipients  to  gain  entry  into  a  medical  care  setting,  and  for 
the  program  to  be  exerting  some  influence  on  the  health  status 
and  the  medical  care  utilization  behavior  of  the  recipients. 

Determining  the  appropriate  sample  size  is  of  primary 
importance.     The  degree  of  accuracy,  precision  and  validity 
required  by  the  investigators  will  determine  the  size  of  the 
sample  required.     Formal  calculations  exist  which  show  the 
accuracy  and  confidence  levels  possible  with  a  given  sample 
size,  however,  they  are  beyond  the  scope  and  purpose  of  this 
paper.     Of  most  importance  is  the   decision  of  the  investigator 
regarding  which  interpretations  are  necessary  and  what  level  of 
precision  is  desired.     This  decision  will  probably  depend  upon 
the  available  time,  manpower  and  financial  resources. 

Appendix  D  further  elaborates  the  technique  of  random 
sampling. 
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Interpretation  of  the  Results 


PART  II 

Interpretation  of  the  Results 

There  are  two  acceptable  approaches  for  analyzing  the 
data  obtained  from  this  study.     They  are:      (1)   empirical  ap- 
proach where  professional  judgement  is  used  to  descriptively 
evaluate  the  rates  calculated  from  the  indicators,  and   (2)  sta- 
tistical approach  where  inferential  statistics  such  as  hypothe- 
sis testing,  chi-square,  F-test,  etc.  are  used.     Since  the  full 
statistical  treatment  of  the  data  is  beyond  the  descriptive 
purpose  of  this  study,  the  inferential  approach  will  not  be 
presented. 

Descriptive  Data  Analysis.     The  primary  objective  of  the  EPSDT 
program  is  to  bring  eligible  children  with  unmet  health  needs 
into  a  health  care  setting  that  is:     1)   preventive,   2)  contin- 
uous, 3)  comprehensive,  and  4)   sensitive  to  recipient  needs  and 
problems.     The  frequency  tabulations  and  the  indicator  rates 
obtained  from  the  data  will  reveal  the  extent  to  which  the  pro- 
gram objective  has  been  met.     Frequency  tables  discussed  in  the 
following  section  are  a  useful  assessment  tool  for  comparing 
the  medical  care  utilization  of  the  Medical  Assistance  groups 
(EPSDT  recipients  vs.  nonEPSDT  recipients). 
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Table  Analyses 

Table  A.     Provider  Encounters  Per  1000  Recipients  by 
Type  of  Provider 

Intra-and-Inter  Group  Comparison  Discussion 

The  type  of  provider  a  recipient  chooses  to  use  is  depen- 
dent on  predisposing  and  enabling  factors.  Predisposing  factors 
such  as  education,  race,  age,  sex,  place  of  residence,  religion, 
all  contribute  to  the  development  of  the  individual's  attitudes 
and  beliefs  which  directly  influence  their  choice  of  providers. 
Enabling  factors  such  as  geographic  location,  income,  provider 
availability  also  influence  an  individual's  choice  of  providers. 

It  is  within  these  constraints  that  the  EPSDT  program 
must  function.     It  is  also   the  impact  of  these  factors  which 
the  EPSDT  program  seeks  to  influence.     A  measure  of  the  program's 
influence  would  be  to  determine  the  type  of  provider  the  reci- 
pients utilize. 

As  previously  mentioned,  certain  types  of  provider  encoun- 
ters are  more  preferred  than  others.     For  example,  the  type  of 
provider  encounter  considered  least  preferred  under  most  cir- 
cumstances is  the  emergency  room  visit.     Although  the  quality 
of  care  given  may  be  high,  this  type  of  care  tends  to  be  crisis- 
oriented  and  expensive. 

Provider  sources  considered  appropriate  from  a  public 
health  standpoint  are  those:      (1)  which  are  capable  of  offering 
a  wide  range  of  preventive  health  care  services;    (2)  which  have 
a  capable  and  permanent  professional  staff;    (3)  which  are  capa- 
ble of  offering  most  of  the  usual  diagnostic  and  treatment  (D&T) 
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services  needed  by  the  recipient;  and,    (4)  which  are  capable 
of  arranging  for  the  timely  provision  of  the  required  D&T  ser- 
vices . 

These  are  macro-level  criteria.     On  an  individual  basis, 
every  provider  has  positive  and  negative  features  from  the  stand- 
point of  the  recipient,  however,  evaluating  the  individual  pro- 
vider is  beyond  the  intent  of  this  study  design. 

Table  A  illustrates  the  pattern  of  providers  utilized 
per  Medical  Assistance  group.     It  is  up  to  the  principal  inves- 
tigator to  determine  if  the  pattern  observed  for  the  EPSDT  reci- 
pients satisfies  the  objectives  of  the  program. 

Table  B.     Mean  Number  of  Different  Types  of  Providers 
and/or  Individual  Providers  Used  Per  Reci- 
pient Per  Year 

Inter-group  Comparison  Discussion 

This  is  a  continuity  measure.     Recipients  who  have  most 
of  their  usual  health  needs  met  by  a  single  provider  are  probably 
being  served  by  a  comprehensive  source  of  care.     The  utilization 
of  a  single  source  of  care   (other  than  emergency  room  visits) 
may  also  reflect  satisfaction  with  or  availability  of  the  medi- 
cal care  being  received. 

Table  C.     Mean  Medical   (Dental)  Visits  Per  EPSDT 
Recipient  Per  Year 

Intra-Group  Comparison  Discussion 

Preventive  medical   (dental)   health  measures  are  most 
effective  in  the  earlier  stages  of  life.     High  utilization  rates 
in  the  lower  age  group  reveals  that  the  program  is  effectively 
reaching  these  individuals.     However,  preventive  medical  (dental) 
care  can  also  be  effective  in  the  older  age  category   (11-21  years) 
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The  behavior  pattern  in  medical   (and  dental)   care  utilization 
in  all  age  groups  requires  careful  monitoring  because:      (1)  re- 
cipients can  directly  influence  their  peers  to  practice  better 
health  care;    (2)   recipients  can  become  parents,  and  therefore 
they  can  influence  the  type  of  care  they  obtain  for  their  chil- 
dren;   (3)   prevention  is  cost-effective. 
Inter-group  Comparison 

We  would  expect  EPSDT  recipients  to  be  utilizing  prevent- 
ive medical   (dental)   services  to  a  greater  extent.     If  both 
groups  experience  relatively  low  utilization  rates  by  place  of 
residence,   it  is  necessary  to  verify  whether  individuals  are  ex- 
periencing difficulty  in  obtaining  access  to  medical  (dental) 
care . 

Tables  D&E.     Number  of  Recipients  with  at  Least  One 
Medical  Care  Provider  Contact  (Dental 
and  Medical)   Per  Group  Per  Year. 

Intra-and-Inter  Group  Comparison  Discussion 

The  data  will  reveal  those  individuals   (by  age,  sex, 

place  of  residence)  who  are  not  being  introduced  to  a  medical 

(dental)   care  source.     Since  the  purpose  of  the  EPSDT  program 

is  to  promote  preventive  medical   (dental)  care,  individuals 

with  inadequate  preventive  medical   (dental)   care  will  require 

further  outreach  efforts  to  assure  that  they  gain  entry  and 

remain  in  the  program.     If  the  data  can  be  obtained,  probability 

measures  can  be  assigned  to  each  group  which  indicates  the  like- 

liness  a  recipient  has  for  being  introduced  to  a  medical  (dental) 

care  source  by  being  enrolled  in  EPSDT. 

Table  F.     Number  of  Well-Care  Service  Requests  Per 
1000  Recipients  Per  Year 
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Inter-Group  Comparison  Discussion 

Individuals  often  present  themselves  to  a  source  of  medi- 
cal care  for  well-care  services.     A  determination  of  the  differ- 
ence in  the  rates  between  the  EPSDT  and  nonEPSDT  Medical  Assist- 
ance groups  could  serve  as  an  estimate  of  the  upper  limit  of 
the  influence  which  the  EPSDT  program  has  had  on  the  utilization 
of  preventive  health  services  by  the  recipient  population. 

Table  G.     Number  of  Preventive  Dental  Visits  Per  1000 
Recipients  Per  Year 

Inter-group  Comparison  Discussion 

This  indicator  measures  the  utilization  rates  for  prevent- 
ive dental  services.     If  both  groups  have  a  low  rate  of  prevent- 
ive dental  encounters,  more  outreach  is  needed.     If  rural  reci- 
pients have  both  a  lower  rate  of  dental  contacts  for  treatment 
and  a  lower  rate  of  preventive  dental  contacts  than  urban  reci- 
pients, accessibility  may  be  a  problem.     If  EPSDT  recipients 
have  a  greater  overall  rate  of  preventive  dental  encounters, 
the  program  may  be  responsible  for  part  of  the  difference.  How- 
ever, part  of  the  higher  rate  of  preventive  encounters  may  be 
due  to  selection  bias.     That  is,  EPSDT  recipients  are  probably 
more  likely  to  use  all  preventive  services,  and  would  have  used 
preventive  dental  services  at  a  somewhat  higher  rate  than  other 
Medicaid  recipients  even  without  EPSDT  services.     A  longitudinal 
design  would  be  needed  to  determine  how  much  of  the  difference 
might  reasonably  be  attributed  to  the  impact  of  the  EPSDT  program. 

Tables  H&I.     Number  of  Hospital  Admissions  Per  1000 

Recipients  Per  Year,  and,  Number  of  Hos- 
pital Admissions  for  Surgical  Treatment 
(or  Other  Reasons  for  Admissions)  Per 
1000  Recipients  Per  Year 


Inter-group  Comparison  Discussion 

If  the  hospitalization  rate  for  EPSDT  recipients  is  lower 
than  for  nonEPSDT  recipients,  this  may  indicate  that  EPSDT  reci- 
pients are  having  their  health  needs  met  before  a  crisis  situa- 
tion develops,  or  it  may  mean  that  they  had  higher  health  status 
prior  to  entering  the  program.     On  the  other  hand,  if  EPSDT 
hospitalization  rates  are  higher,  it  may  be  that  the  EPSDT 
population  has  a  backlog  of  health  needs  which  are  being  iden- 
tified and  corrected.     However,  only  a  longitudinal  design  can 
provide  appropriate  data  to  determine  which  interpretation  is 
correct.     In  the  long  run,  it  is  expected  that  EPSDT  recipients 
will  have  a  lower  rate  of  hospitalization  and  a  lower  rate  of 
surgical  services  than  their  nonEPSDT  counterparts. 

Composite  Comparative  Medical  Care  Utilization  Chart 

The  following  Chart  summarizes  the  overall  medical  care 
utilization  behavior  of  both  the  Medical  Assistance  EPSDT  and 
nonEPSDT  groups.     By  collecting  the  data  and  placing  it  in  the 
following  format,  the  evaluator  may  be  able  to  determine  if 
distinctly  different  patterns  of  health  care  utilization  exist 
between  the  groups. 
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Composite  Recipient  Medical  Care  Utilization 


Indicator  Medical  Assistance  Group 

EPSDT  nonEPSDT 

1.     Provider  encounters  per 
1000  recipients,  per  year. 


Health  Department 
Neighborhood  Health 

Center 
Health  Maintenance 

Organization 
Hospital  Outpatient 

Department 
Emergency  Room 
Private  Physician 
Other  (specify) 


2.     Mean  medical  visits  per  reci- 
pient, per  year 


3.     Mean  dental  visits  per  recipient, 
per  year 


4 .     Number  of  recipients  with  at 

least  one  dental  contact,  per  year 


5.  Number  of  recipients  with  at  least 
one  initial  medical  contact,  per 
year 

6.  Number  of  well-care  service  requests 
per  year 

7 .  Number  of  preventive  dental 
visits  per  1000  recipients  per 
year  ' 

8.  Mean  number  of  different  types 
of  providers  and/or  individual 
providers  used  per  recipient, 
per  year 

9.  Number  of  hospital  admissions 
for  surgical  treatment  per  1000 
recipients,  per  year 

10.     Number  of  hospital  admissions 
per  1000  recipients/  per  year 
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Medical  Care  Service  Cost  Breakdown 


The  indicators  used  in  this  analysis  are  the  cost  cate- 
gories -  physician  services,  optical  appliances,  prescriptions, 
etc.  -  for  which  payments  have  been  made.     A  comparison  of  the 
cost  patterns  between  the  Medical  Assistance  groups  provides  a 
rough  estimate  of  their  respective  service  utilization  patterns. 

A  major  cost  indicator  is  the  ratio  of  hospital  inpatient-out- 
patient  costs.     A  comparison  of  the  outpatient/inpatient  ratio 
between  the  Medical  Assistance  groups  reveals  which  group  relies 
most  heavily  on  inpatient  care. 


Cost  Breakdown 


Program  cost  breakdown  by 

service  category  for  entire  Medical 

Assistance  Drooram. 

Medical  Assistance  Program 

Cost  Service  Category 

Cost/Person      Percent  of  Total 

Physician  services 

Dental  services 

Mental  health 

Hospital 

Inpatient 

Outpatient 

Prescribed  drugs 

Home  health  visits 

Laboratory  and  X-ray 

Clinic  services 

Medical  supplies 

and  prosthetics 

Optometric  examination 

Optical  appliances 

Other  services 

Average  Cost  Per  Person 
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Parent  Satisfaction  Questionnaire 
(See  Appendix) 

An  EPSDT  program  impact  assessment  cannot  be  considered 
complete  without  obtaining  input  from  the  parents  of  the  reci- 
pients.    If  the  financial  and  manpower  resources  permit,  it  is 
recommended  that  the  questionnaire   (or  a  similar  survey)  be  in- 
corporated into  the  study. 

This  questionnaire  was  developed  to  gather  input  from 
parents  concerning  the  quality  and  comprehensiveness  of  the 
medical  care  given  their  children.     It  is  one  way  to  measure 
the  parent's  satisfaction  with  the  Medical  Assistance  program 
for  their  children. 

The  design  of  this  questionnaire  is  flexible  enough  to 
allow  the  EPSDT  coordinator  to  alter  the  format  to  suit  specific 
needs . 

The  questionnaire  should  be  mailed  to  parents  randomly 
selected  from  the  sampled  populations  of  Medical  Assistance 
recipients.     A  cover  letter  explaining  its  purpose  and  express- 
ing assurance  about  preserving  the  confidentiality  of  the  infor- 
mation should  be  included. 

The  frequency  of  the  responses  given  to  the  individual 
questions  should  be  compared  between  both  of  the  Medical  Assist- 
ance groups.     If  a  response  rate  of  less  than  4  0%  occurs,  the 
interpretation  of  the  data  should  be  approached  with  caution. 

In  the  event  this  questionnaire  is  not  used  and  a  dif- 
ferent survey  instrument  is  developed,  it  is  recommended  that 
some  of  the  following  areas  be  reflected  in  the  new  questionnaire 
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(1)  Sensitivity 

Questions  should  be  asked  of  the  parents  regarding 
their  perception  of  how  sensitive  the  medical  care 
source  is  to  the  socio-cultural  heritage  of  the  reci- 
pients .     Parents  will  not  be  motivated  to  continue  using 
a  source  of  care  which  is  indifferent  to  the  socio-cul- 
tural needs  of  the  recipients. 

(2)  Continuity 

Fragmented  sources  of  health  care  delivery  do  not 
motivate  appropriate  behavior  in  recipient  health  care 
utilization.     Questions  should  be  directed  towards  deter- 
mining the  extent  to  which  a  primary  source  of  care  is 
utilized.     High  utilization  can  be  indicative  of  satis- 
faction with  the  level  of  accessibility  to  that  parti- 
cular source  of  care.     If  the  entire  family  uses  that 
source  this  can  also  reflect  satisfaction  and/or  level 
of  accessibility. 

(3)  Comprehensiveness 

Parents  should  be  asked  if  most  of  their  preventive 
and  primary  care  health  needs  are  being  met  by  their 
principal  source  of  care. 

(4)  Program  Satisfaction 

Parents  should  be  asked  if  they  are  satisfied  with 
the  effort  the  Medical  Assistance  program  is  making  to 
involve  their  children  with  an  appropriate,  comprehensive 
and  accessible  source  of  health  care. 

Also  parents  should  be  asked  to  identify  the  problems 
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they  are  still  encountering  when  they  seek  medical 
care  for  their  enrolled  children. 


Appendix  A 


Composite  Medical  Care 
Utilization  Tables 
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Composite  Table  Construction 


TABLE  A 

Provider  encounters  per  1000  EPSDT  recipients  by  type  of  provider   (repeat  for  nonEPSDT  sample) 


Provider  Type 


Sample 

Characteristics 


Health 
Department 


Neighborhood 

Health 

Center 


Health 

Maintenance 

Organization 


Emergency 
Room 


Hospital 

Outpatient 

Department 


Private 
Physician 


Other 
(specify) 


Age 


0-5 
6-10 
11-15 
16-21 


Sex 

Male 
Female 

Race 

White 
Non  White 


Residence 

Rural 
Urban 


TOTAL 


TABLE  B 

Mean  number  of  different  types  of  providers  and/or  indivi- 
dual providers  used  per  recipient  per  year. 


Mean  Number  of  Different  Provider  Types 
Sample  EPSDT  Recipients  nonEPSDT  Recipients 


Age 

0-5 

6-10 
11-15 
16-21 

Sex 

Male 
Female 

Race 

White 
Non  White 

Residence 

Rural 
Urban 
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TABLE  C 

Mean  medical  visits 

(dental  visits)  per  EPSDT 

recipient 

per  year  (repeat  for 

nonEPSDT  group) 

Medical  Visits 

(Dental  Visits) 

Sample 

Frequency  Mean 

Number 

Age 


0-5 

6-10 
11-15 
16-21 

Sex 

Male 
Female 

Race 

White 
Non  White 

Residence 

Rural 
Urban 


TABLE  D 

Number  of  EPSDT  recipients  with  at  least  one  initial  medi- 
cal contact  per  year   (repeat  for  nonEPSDT  group) 


Initial  Contacts 

No.  With  at         No.  With        No.  With  No.  With- 
Least  One  Med-    No  Medical     Treatment  out  Treat- 
Sample              ical  Contact        Contact          Contact  ment  Contact 


Age 

0-5 

6-10 
11-15 
16-21 

Sex 

Male 
Female 

Race 

White 
Non  White 

Residence 

Rural 
Urban 


TOTAL 
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TABLE  E 

Number  of  EPSDT  recipients  with  at  least  one  dental  con- 
tact per  year   (repeat  for  nonEPSDT  group) 


Initial  Contacts 

Sample 

No.  With  at          No.  Without 
Least  One             an  Initial 
Dental  Contact     Dental  Contact 

No.  With 

Treatment 

Contact 

No.  With- 
out Treat- 
ment Contact 

Age 


0-5 

6-10 
11-15 
16-21 

Sex 

Male 
Female 

Race 

White 
Non  White 

Residence 

Rural 
Urban 


TOTAL 


TABLE  F 

Number  of  well-care  service  requests  per  1000  recipients 
per  year 


Well-Care  Service  Requests 
Sample  EPSDT  recipients  nonEPSDT  recipients 


Age 

Develop 

Categories 

Accordingly 


Sex 

Male 
Female 

Race 

White 
Non  White 

Residence 

Rural 
Urban 


TOTAL 


TABLE  G 

Number  of  preventive  dental  visits  (6  month  periodic  check-up,  fill- 
ings, cleaning  of  teeth)   per  1000  recipients  per  year. 


Preventive  Dental  Visits 


Sample 


Frequency 


EPSDT  Recipients 


#/1000  recipients 


nonEPSDT  Recipients 


Frequency 


#/1000  recipients 


Age 


0-5 
6-10 
11-15 
16-21 


Sex 


Male 
Female 


ace 


White 
Non  White 

Residence 

Rural 
Urban 


TOTAL 
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TABLE  H 

Number  of  hospital  admissions  per  1000  recipients  per  year 


Medical  Assistance  Group 
Sample  EPSDT  nonEPSDT 


Age 

0-5 

6-10 
11-15 
16-21 

Sex 

Male 
Female 

Race 

White 
Non  White 

Residence 


Rural 
Urban 


TABLE  I 

Number  of  hospital  admissions  for  surgical  treatment  per  1000  reci 
pients  per  year. 


Inpatient  Hospital  Utilization 

nonEPSDT  Recipients   EPSDT  Recipients 

Sample  Surgical  Services  Surgical  Services 


Age 


0-5 
6-10 
11-15 
16-21 


Sex 


Male 
Female 


Race 


White 
Non  White 


Residence 


Rural 
Urban 


Computing  Utilization  Rates 

The  utilization  rate  is  the  average  number  of  provider 
encounters  per  person  per  year.     The  general  approach  for  cal- 
culating the  utilization  rate  is  as  follows: 


number  of  events  of  interest  which  occur 

 in  a  given  period  of  time  

number  of  persons  who  could  experience 
the  event  of  interest  during  the  same  period  of  time 


It  is  important  to  remember  that  the  denominator  must 
only  include  individuals  of  the  same  sex,  age  or  ethnicity 
category  of  interest.     For  example,  if  you  are  calculating 
the  encounter  rate  of  Males,  age  0-5,  you  must  have  in  the 
denominator  the  total  population  of  individuals  in  that  sex 
and  age  category,  not  the  total  population  of  the  sample. 
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Appendix  B 


Parent  Satisfaction  Questionnaire 
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m 


PARENT  SATISFACTION 


QUESTIONNAIRE 


Code  Number 


Name  of  Parent  (Guardian) 


Last  First  Middle  Init. 

Home  Address:  

Street  Address  City 


County  Zip  Code 

Medical  Assistance  I.D.  Number:  , 

t 

QUESTIONNAIRE 

I.     Overall  Provider  Satisfaction  Assessment 

Your  answers  to  the  following  questions  will  help  us  determine 
the  overall  quality  of  the  medical  care  you  are  receiving. 

Questions  Responses 

NOT  QUESTION  DOES 

YES         NO         SURE  NOT  APPLY 

1.  Are  you  completely  satisfied  (  )  (  )  (  )  (  ) 
with  the  overall  medical  care  *  * 
your  child  is  receiving? 

2.  Do  you  feel  that  your  doctor  (  )  (  )  (  )  (  ) 
or  nurse  carefully  explains 

to  you  the  health  condition 
of  your  child? 

3.  Does  your  doctor  or  nurse  (  )         (  )       (  )  (  ) 
carefully  explain  the  treat- 
ment required  for  your  child 

when  your  child  is  ill? 

4.  Is  your  doctor  or  nurse  atten-       (  )      .    (  )       (  )  (  ) 
tive  to  your  opinion  about 

your  child's  health  and  needs? 


ft 


8. 


9. 


Questions 


Do  you  feel  that  your  child 
is  receiving  personal  health 
care? 

Are  you  confident  that  the 
health  care  your  child  is 
receiving  is  of  good  quality? 

Do  you  believe  that  your 
child's  health  has  improved 
as  a  result  of  the  treatment 
being  given? 

Do  most  of  your  family  use 
the  same  doctor/clinic? 

Would  you  recommend  your 
child's  doctor/clinic  to  any- 
one else? 


YES 


(  ) 


NO 
(  ) 


Responses 

NOT 
SURE 


(  ) 


(   )  (   )        (  ) 


(   )  (   )        (  ) 


(  ) 


(  ) 


(   )        (  ) 


(   )        {  ) 


QUESTION  DOES 
NOT  APPLY 

(  ) 


(  ) 

(  ) 

(  ) 

(  ) 


Accessibility  Assessment 

Your  responses  to  the  following  questions  will  help  us  identify 
the  problems  you  may  be  having  in  getting  your  children  to  their 
doctor/clinic. 


Questions 

How  much  travel  time,  on  the  average, 
does  it  take  you  to  get  your  chil- 
dren to  their  doctor/clinic? 


Is  this  traveling  time  of  great 
inconvenience  to  you? 

Once  you  are  at  the  office  of  the 
doctor/nurse  how  long  do  you  have 
to  wait  to  be  attended? 


How  much  total  time  do  you  spend,  on 
the  average,   to  visit  your  child's 
doctor/clinic  -  include  travel  time, 
time  waiting  to  see  a  doctor/nurse 
time  your  child  spends  with  the  doc- 
tor/nurse/ clerks,  time  to  travel  home, 


Responses 

15  minutes 
30  minutes 

1  hour 

2  hours  or  more 


C  ) 
(  ) 
(  ) 
(  ) 


YES 
(  ) 


NO 
(  ) 


15  minutes 
30  minutes 

1  hour 

2  hours  or  more 

1  hour 

2  hours 

3  hours 

4  hours  or  more 


( 
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Questions 


Responses 


QUESTION  NOT 


Is  there  a  doctor/health  center/ 
hospital  that  is  closer  to  you  but 
for  some  reason  you  were  not  ac- 
cepted as  a  regular  patient? 

6.  If  a  non-emergency  medical  problem 
developed  with  your  child,  do  you 
feel  that  you  have  a  health  care 
place  to  which  you  can  go? 

7.  To  what  extent  do  the  following  obstacles  prevent  you  from  bringing 
your  child  to  the  doctor? 


YES 

NO 

APPLICABLE 

(  ) 

(  ) 

(  ) 

YES 

NO 

(  ) 

(  )- 

1. 


A  VERY 
GREAT 
PROBLEM 

a.  Getting  transportation 

to  medical  care  services         (  ) 

b.  Finding  a  medical  care 

place  to  which  you  can  go       (  ) 

c.  Finding  someone  to  take  (  ) 
care  of  my  other  children 
while  I'm  gone  with  my 

child  to  the  doctor 

d.  Arranging  an  appointment         (  ) 
with  a  doctor 

e.  Finding  a  specialist  for         (  ) 
my  child's  special  medical 
problems 

f.  Finding  the  time  to  take         (  ) 
my  child  to  a  doctor 


FAIRLY 
GREAT 
PROBLEM 


(  ) 


BIT 
OF  A 
PROBLEM 


(  ) 


NOT 
A 

PROBLEM 


(  ) 


(  ) 

(  ) 

(  ) 

(  ) 

(  ) 


(  ) 

(  ) 

(  ) 

(  ) 

(  ) 


(  ) 
(  ) 

(  ) 
(  ) 

(  ) 


III.  Provider  Assessment 

Your  answers  to  the  following  questions  will  help  us  determine  the 
overall  quality  of  the  health  services  you  are  receiving. 


Questions  - 

Do  you  feel  that  you  can  get  most  of 
your  child's  health  needs  met  (that 
is,  medical,  dental,  preventive  care, 
counseling,  home-care,  mental  health) 
at  your  child's  regular  source  of 
health  care? 
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YES 
(  ) 


Responses 

NO 
(  ) 


NOT 
SURE 
(  ) 


Questions 

Of  the  following  types  of  services 
that  your  child  is  not  receiving 
now,  which  would  you  like  to  see 
offered? 

Do  you  feel  that  you  have  been 
properly  informed  about  the  types 
of  services  offered  by  your  doctor/ 
clinic? 

Is  your  doctor/clinic  able  to  refer 
your  child  to  another  conveniently 
located  doctor/clinic  when  medical 
care  cannot  be  provided  there? 

Does  your  doctor/clinic  help  you 
arrange  an  appointment  when  your 
child  has  been  referred  for  medical 
care  elsewhere? 

Were  you  ever  refused  another  appoint- 
ment by  your  child's  doctor/clinic 
because  you  missed  a  few  appointments? 

Does  your  child's  doctor/clinic  in- 
form you  in  advance  by  telephone  or 
post-card  of  your  child's  appointment? 

a.  When  you  bring  your  child  back  for 
further  regular  medical  care,  do  you 
see  the  same  doctor/nurse? 

b.  If  NO,  would  you  rather  that  the  same 
doctor/nurse  attend  your  child? 


Responses 

Mental  Health  (  ) 

Counseling  (  ) 

Outreach  Services  (  ) 


Preventive  Care 
NOT 

YES  NO  SURE 
(   )  (   )        (  ) 


(  ) 


YES 


(  ) 


YES 


(  ) 


NOT       QUESTION  NOT 
NO       SURE  APPLICABLE 


(   )      (  ) 


NO 


YES 
(  ) 


YES 
(  ) 


YES 
(  ) 


(  ) 


NOT  QUESTION  NOT 
SURE  APPLICABLE 


(   )      (  ) 


YES 
(  ) 


NO 
(  ) 


NO 

T~) 


NO 
(  ) 


NO 
(  ) 

NOT 
SURE 
(  ) 


(  ) 

QUESTION  NOT 
APPLICABLE 
(  ) 

QUESTION  NOT 
APPLICABLE 
(  ) 

QUESTION  NOT 
APPLICABLE 
(  ) 

NOT 
IMPORTANT 
(  ) 


Does  your  doctor/clinic  inform  you 
of  the  specific  services  they  have 
given  your  child? 

Do  you  feel  that  some  of  the  medical 
care  services  given  to  your  child  are 
unnecessary? 

In  general,  do  you  feel  comfortable 
with  the  attitude  expressed  by  the 
doctor/staff  towards  you  and  your 
child? 

Does  your  child's  doctor/nurse  discuss 
the  benefits  of  using  preventive  health 
care  with  you  and  your  child? 


YES 

TT 


YES 
(  ) 

YES 
(  ) 


YES 
(  ) 


NOT 
NO  SURE 

T) 


NO 
(  ) 

NO 
(  ) 


NO 
(  ) 


J  ) 

QUESTION  NOT 
APPLICABLE 
(  ) 


Questions 


Responses 


14. 


15. 


Does  your  doctor/clinic  encourage 
other  members  of  your  family  to  seek 
regular  care  from  them. 

Please  check  the  regular  source  of 
health  care  your  child  uses. 


Please  check  an  alternate  source 
of  care  your  child  uses  less  regu- 
larly. 


YES 
(  ) 


NO 
(  ) 


QUESTION  NOT 
APPLICABLE 


(  ) 


a.  Health  Department 

b.  Neighborhood  Health 

Center 

c.  Health  Maintenance 

Organization 

d.  Hospital  Outpatient 

Department 

e.  Emergency  Room 

f.  Private  Clinic 

g.  Private  Doctor 

h.  Public  Clinic 

i.  Other 

a.  Health  Department 

b.  Neighborhood  Health 

Center 

c.  Health  Maintenance 

Organization 

d.  Hospital  Outpatient 

Department 

e.  Emergency  Room 

f.  Private  Clinic 

g.  Private  Doctor 

h.  Public  Clinic 

i .  Other 


IV.     Prevention  Assessment 


Your  answers  to  the  following  questions  will  help  us  determine  the 
effectiveness  of  this  preventive  health  care  program.  *  : 


1.  Do  you  find  yourself  practicing 
more  personal  preventive  health 
care  in  your  home  as  a  result  of 
your  enrollment  in  the  Medical 
Assistance   (Medicaid)  program? 

2.  Do  you  find  yourself  visiting  your 
doctor/clinic  to  seek  more  preven- 
tive medical  care  for  yourself  and 
your  family  as  a .result  of  your  ' 
enrollment  in  the  Medical  Assist- 
ance  (Medicaid)  program? 


YES 

TT 


YES 
(  ) 


NO 

T) 


NO 
(  ) 


Questions 
Program  Assessment 


Responses 


Your  answers  to  the  following  questions  will  help  us  determine 
the  overall  quality  of  your  experiences  with  this  preventive 
health  care  program. 

Was  your  Social  Services  Department  YES  NO 

helpful  in  explaining  the  benefits  (  )  T~) 

to  be  gained  by  practicing  preventive 
health  care? 

Was  your  local  Social  Services  de- 
partment responsive  to  your  request  YES  NO 
for  assistance  in  arranging  for  day  (  )  (  ) 
care  and/or  transportation  services? 

How  did  you  learn  about  the  Medical 
Assistance   (Medicaid)  program? 


QUESTION  NOT 
APPLICABLE 
(  ) 


Social  Services  Worker  (  ) 

Friend  (  ) 

Advertisement  (  ) 

Other  (  ) 


Would  you  recommend  your  Medical 

Assistance   (Medicaid)   program  to  eli-  YES  NO 

gible  friends  and  neighbors?  (  )  (  ) 


NOT 
SURE 
(  ) 
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Appendix  C 


Recommended  Criteria  for  Assessing 
the  Appropriateness  of  the  Identified  Medical  Acquisition  Behavior 
as  Reflected  by  an  Assessment  of  the  Source  of  Medical  Care  Utilized 


► 


Appendix  C 
ecommended  Criteria  for  Assessing 
the  Appropriateness  of  the  Identified  Medical  Care  Acquisition  Behavior 
as  Reflected  by  an  Assessment  of  the  Source  of  Medical  Care  Utilized 
This  section  will  briefly  present  three  widely  recognized 
criteria  for  determining  the  appropriateness  of  the  medical  care 
acquisition  behavior  observed  of  the  Medical  Assistance  (Medicaid) 
recipients  sampled.     The  criteria  -  comprehensiveness,  continuity, 
recipient  satisfaction  -  were  chosen  because  of  their  amenability 
to  the  analytical  approach  used  in  this  comparative  study.  Other 
criteria  do  exist,  and  while  not  presented  here,  the  EPSDT  Coor- 
dinator is  encouraged  to  identify  and  develop  those  criteria  de- 
sired. 

Appropriateness  Criteria 


•Criterion  A. 

Comprehensiveness 


•Definition. 


Comprehensiveness,  as  presented  here,  is  more  related 
to  the  type  of  medical  care  source  utilized   (e.g.,  Health  Depart- 
ment, Emergency  Room,  Hospital  Outpatient  Department,  etc.)  than 
to  the  type  of  medical  care  service  received.  Comprehensive 
care  is  a  system  which  is  family  centered;  is  capable  of  deliver- 
ing preventive,  diagnostic,  therapeutic,  advisory,  rehabilitative 
services  on  a  timely  and  continual  basis;   is  manned  by  permanent 
professional  and  allied  professional  staff. 

•Measures. 


Type  and  Scope  of  services  available 

Family  Planning 
Mental  Health  Care 
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Well-Child  Care 
Counseling 

Alcohol  and  Drug  Abuse  Care 
Rehabilitative  Services 
Diagnostic  and  Treatment  Services 
Screening  Services 

Preventive  Services  and  Counseling 

Outreach  Services 

Home  Health  Care 

Dental  Services 

Other 

Type  of  Technical  Resources  Available 

a.  Facilities: 

Laboratory  Facilities: 
X-Ray  Facility 
Dental  Facilities 
Screening  Facilities 
Other 

b.  Equipment: 

Audiometer 
Examining  Table 
X-Ray  Equipment 
Blood  Analyzers 
Other  . 

Number  and  Type  of  Professional  on  Staff 

a.  Physicians: 

General  Practitioner 

Pediatrician 

Psychiatrist 

Osteopath,  D.O. 

Internist 

Opthamologist 

Other 

b.  Dental: 

Dentist 
Orthodontist 
Periodontist 
Other 

c.  Allied  Health  Personnel 

Social  Worker 

Dental  Hygienist 

Family  Health  Coordinator 

Nurse   (R.N. ,  L.P.N. ,  Nurse  Technologist) 

Nurse  Practitioner  (Pediatric) 

Occupational  Therapist 

Physical  Therapist 

Optometrist 
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Physician  Assistant 
Public  Health  Nurse 
Medical  Technologist 
Outreach  Worker 
Other 

Approach  for  Development. 

Because  of  the  sensitive  nature  of  this  criterion,  con- 
sultation from  medical  providers  should  be  sought.     There  are 
certain  types  of  medical  care  providers  which  cannot  provide 
comprehensive  care,  yet  because  of  their  availability  to  reci- 
pients, their  involvement  in  the  program  is  needed  and  appre- 
ciated.    Criteria  such  as  comprehensiveness  needs  to  be  mea- 
sured against  other  criteria  such  as  accessibility  in  order 
to  determine  the  overall  appropriateness  of  the  medical  care 
source  used  by  recipients. 

A  general  analytical  approach  would  be  to  develop  a  ra- 
ting scale  according  to  the  comprehensiveness  measures  chosen. 
Provider  sources   (Health  Department,  Hospital  Outpatient  Depart- 
ment, Private  Provider,  Private  Clinic,  Neighborhood  Health 
Center)   are  then  generally  assigned  a  rating.     Agreement  on  the 
measures  to  be  selected  can  be  achieved  by  involving  an  ad  hoc 
provider  advisory  committee  using  the  Delphi  technique. 

Criterion  B. 

Continuity 
Definition. 

Obtaining  medical  care  services  on  a  continuous  basis 
from  the  same  capable  medical  care  source. 
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•  Measures. 

Recipient  Related 

Number  of  different  pro- 
viders used  for  the  same 
condition 

Number  of  referrals  to 
different  types  of  pro- 
viders 

Duration  with  same  provi- 
der 

Nature  of  the  recipient's 
illnesses 


Facility  Related 

Comprehensiveness  of 
services  offered 

Hours/week  services 
are  available 

Days  facility  is  open 

Geographic  accessibility 


•  Criterion  C. 

Satisfaction 

•  Definition. 

Degree  of  appreciation  recipient/parent  has  for  the  medi- 
cal care  received  by  the  recipients. 
•Measures. 

Low  Broken  Appointment  Rate 
Completion  of  therapeutic  regimen 
Introducing  other  family  members 

to  same  source  of  care  (barring 

effect  of  poor  accessibility  to 

other  sources  of  care) 
Duration  with  same  provider 
Adopting  preventive  health  measures 
Recommendations  made  to  other  eligible 

individuals 
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Appendix  D 
Suggested  Sampling  Designs 


1 
1 
[ 


Sampling  Design 


Cost  factors  limit  the  degree  of  complexity  a  sampling 
technique  can  have.     The  expenditures  made  to  develop  a  full- 
scale  sampling  approach  can  outweigh  the  benefits  to  be  gained. 
Validity  and  representativeness  can  be  maintained  in  a  simpli- 
fied sampling  technique  if  the  following  developmental  stages 
are  used: 

•  1.     Define  Objectives.     For  this  assessment  study  there  are 
two  objectives.     The  first  overall  objective  is  to  identify 
and  assess  the  health  status  and  the  medical  care  utilization 
behavior  of  the  Medical  Assistance  EPSDT  and  nonEPSDT  reci- 
pients.    This  is  an  administrative  objective. 

The  second  objective  is  related  to  the  evaluation  meth- 
odology of  the  assessment  study/  that  is,  to  choose  a  sampling 
technique  which  draws  upon  samples  of  recipients  that  are  rep- 
resentative of  the  respective  groups  being  studied  without  also 
increasing  the  sampling  error. 

•2.     Define  Medical  Assistance  Recipients.     Categories  such  as 
age,   sex,  race,  place  of  residence  must  be  included  in  this 
assessment  study.     The  health  status  and  medical  care  acquisi- 
tion of  recipients  is  dependent  upon  these  behavior  character- 
istics.    For  example:     (1)  many  diseases  are  age  related, 
therefore  it  is  important  to  know  what  the  illness  experience 
of  recipients  in  the  various  age  categories  has  been,     (2)  place 
of  residence  -  urban,  rural  -  is  a  major  indication  of  the  level 
of  accessibility  to  a  medical  source  which  recipients  residing  in 
those  locations  would  have.     Therefore,  more  would  be  known, 
about  the  program  recipients  if  they  are  placed  into  specific 
sub-categories  according  to  age,   sex,   race,  place  of  residence. 

•3.     Define  Study  Constraints.     Such  as:      (1)   Cost  factors  -  per- 
sonnel, training,  data  retrieval,  computer  evaluation  -  which 
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limit  the  sophistication  of  the  sampling  design;     (2)  objective 
of  study;     (3)  availability  of  the  information  necessary  to 
do  the  evaluation;      (4)   time  limitation;      (5)   availability  of 
skilled  evaluation  personnel  such  as  survey  researchers. 

The  objective  or  purpose  of  the  study  influences  the 
level  of  sophistication  required  to  perform  the  evaluation.  If 
the  primary  objective  is  to  identify  and  assess  the  health  sta- 
tus and  medical  care  utilization  behavior  of  recipients,  then 
the  design  of  the  study  is  different  from  an  evaluation  study 
having  a  causality  component  built-in.     A  causality  approach 
would  place  more  stringent  demands  upon  the  evaluation  design. 
•4.     Determine  Appropriate  Sampling  Design.     The  following  com- 
posite graphic  display  depicts  the  different  strata  and  popula- 
tion categories  of  importance  to  this  study. 


Categories 

(1)  Sex 

(2)  Race 

(3)  Residence 

(4)  Age 


Strata 


To  simplify  the  diagram,   let  us  look  at  one  set  of  reci- 
pients -  non-white,   female  and  follow  the  various  categories 
this  group  can  be  in. 


FEMALE 


AGE  0-5 


6-10 


NON-WHITE 
SURAL 
11-15  16-21 
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It  can  be  seen  from  the  above  diagram  that  the  group, 
non-white  female,  can  be  divided  into  six  sub-categories  ac- 
cording to  place  of  residence  and  age.     When  we  consider  all 
four  sets  of  recipients  -  non-white  female,  white  female,  non- 
white  male,  white  male  -  there  are  a  total  of  twenty-four  sub- 
categories needing  analysis.     By  assessing  the  twenty-four 
sub-categories,  a  detailed  picture  of  the  health  status  and 
medical  care  utilization  behavior  can  be  developed.     Both  inter- 
and-intra  group  analysis  can  be  made  upon  the  populations  sam- 
pled. 

Two  useful  sampling  techniques  will  be  described  in  the 
following  section.     Both  have  certain  advantages  and  disadvan- 
tages as  determined  by  the  list  of  study  constraints  generated 
in  step  number  three.     The  two  sampling  approaches  presented 
are  not  the  only  techniques  available  to  the  evaluator. 

a.     Simple  Random  Sampling 

Simple  random  sampling   (SRS)   is  a  systematic  sel- 
ection process  where  individuals  are  chosen  from  a  list  (Master 
Medical  Assistance  list;   0-21  age  category)   according  to  a  pre- 
determined interval  unit.     For  example,   samples  could  be  selec- 
ted from  the  EPSDT  file  by  deciding  that  every  10th  recipient 
on  the  list  will  be  included  in  the  sample.     The  specific  pro- 
cedure would  be  as  follows: 

•1.     Determine  an  interval  unit.     The  size  of  the 

interval  unit  is  dependent  upon  the  total  size 
of  the  Medical  Assistance  recipients  and  the 
final  size  of  the  sample  desired.     It  is  also 
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dependent  upon  the  size  of  the  sampling  error 
the  evaluator  is  willing  to  tolerate.  Note: 
the  sampling  error  is  influenced  more  by  the 
absolute  size  of  the  sample  to  the  population 
than  by  the  proportion  of  the  sample  to  the 
population. 

List  the  recipients  chosen  and  dichotomize 
according  to  age,  sex,  race  and  place  of  resi- 
dence. 

List  number  of  individuals  in  each  category. 
For  example; 

Sex:  Male  Female 

n  =    n  =   

Race:  White  .   

Non-White     

Residence:  Urban     

Rural     

Age:  0-5     

6-10     

11-15     

16-21     

Further  divide  into  sub-categories  and  list 
number  of  individuals  within  each  sub-category. 
For  example; 
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EPSDT  A 


Sub-Category 

Male,  White,  Urban,  0-5  years 

Male,  White,  Urban,  6-10  years 

Male,  White,  Urban,  11-15  years 

V  Male,  White,  Urban,  16-21  years 


Number 


EPSDT  B 


Male, 

White, 

Rural , 

0-5  years 

Male, 

White, 

Rural , 

6-10  years 

Male, 

White, 

Rural , 

11-15  years 

Male, 

White, 

Rural , 

16-21  years 

Repeat 

•5.     List  health  status  and  medical  care  acquisi- 
tion behavior  according  to  indicators  being 
used  for  each  sub-category. 
The  major  disadvantage  of  this  approach  is  that  there 
are  no  controls  over  the  representativeness  of  the  sample  to 
the  population.     For  example,  a  sub-category,  such  as,  female, 
non-white,  rural,   0-5  years  may  be  underrepresented.  Weight 
factors  would  have  to  be  assigned  to  each  sub-category  in  or- 
der to  compare  the  rates  obtained  with  the  other  sub-categories 
within  the  EPSDT  group  and  between  the  sub-categories  of  the 
other  Medical  Assistance  nonEPSDT  groups. 

The  advantages  of  this  approach  are:      (1)   it  is  simple, 
(2)   the  data  is  obtained  swiftly,      (3)   the  cost  of  collecting 
the  data  is  less. 


b.     Stratification:  Unequal  Probabilities  of  Selection 
The  basic  approach  of  this  method  is  to  select 
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sub-categories  of  recipients  according  to  their  pro- 
portion in  the  population.     For  example,  if  20%  of 
the  EPSDT  recipients  are  white  females  in  the  0-5 
age  category,  then  the  sample  selected  of  this  sub- 
category should  reflect  this  proportion.     The  follow- 
ing procedure  is  recommended: 
•1.     From  the  Master  file  determine  the  proportion 
of  each  sub-category  in  the  population  of 
recipients.     This  should  be  done  for  the  EPSDT 
and  Medical  Assistance  nonEPSDT  recipients. 
•2.     After  the  proportions  are  determined,  convert 
this  figure  into  the  size  of  samples  needed 
for  each  sub-category. 
•3.     Select  individuals  randomly  from  the  total  sub- 
population  until  the  sub-sample  size  has  been 
reached. 

•4.     To  compare  the  Medical  Assistance  EPSDT  group 
with  the  nonEPSDT  group,  weight  factors  re- 
flecting the  differing  proportions  of  recipi- 
ents would  have  to  be  applied. 
The  major  advantage  of  this  approach  is  that  maximal 
representativeness  is  maintained  and  intra-inter  group  compar- 
isons can  be  made. 

5.     Sample  Validation.     Validate  the  representativeness  of  the 
samples  to  the  population  they  were  taken  from  by  the  following 
statistical  method  after  the  data  has  been  tabulated: 

a.     estimate  the  population  mean  by  selecting  an 
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indicator  (perhaps  mean  number  of  physician  visits 
per  person  per  year)   that  would  be  indicative  of 
the  utilization  behavior  of  each  MA  group; 

Sample  mean  = 

x  =   (1/n)  2  (x±) 

Estimated  population  mean  = 

x'  =  x 

b.     estimate  the  standard  error  of  the  estimate; 

Sample  variance  = 

VAR    =         (xj) 2  -  (x) 
n 

Estimate  population  variance  = 

S2  =      n  VARx 
n-1 

Estimate  of  the  standard  error  = 


S-  = 
x 


2 

N-n  s 


1 


N  n 

c.     establish  confidence  interval  (usually  95%)  and 
confidence  limit. 
*Note:     The  complete  statistical  treatment  of  the  data  is  beyond 
the  descriptive  purpose  of  this  study.     It  is  recommended  that 
an  in-house  statistician  be  consulted  as  the  need  arises. 


If 


